-- Logs begin at Fri 2022-10-14 02:17:41 UTC, end at Fri 2022-10-14 03:23:28 UTC. -- Oct 14 02:58:22.507702 dv-cinder-801522-13-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 14 02:58:22.516926 dv-cinder-801522-13-smb devstack@n-api.service[104248]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 14 02:58:22.518928 dv-cinder-801522-13-smb devstack@n-api.service[104248]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 14 02:58:22 2022] *** Oct 14 02:58:22.518928 dv-cinder-801522-13-smb devstack@n-api.service[104248]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 14 02:58:22.518928 dv-cinder-801522-13-smb devstack@n-api.service[104248]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 14 02:58:22.518928 dv-cinder-801522-13-smb devstack@n-api.service[104248]: nodename: dv-cinder-801522-13-smb Oct 14 02:58:22.518928 dv-cinder-801522-13-smb devstack@n-api.service[104248]: machine: x86_64 Oct 14 02:58:22.518928 dv-cinder-801522-13-smb devstack@n-api.service[104248]: clock source: unix Oct 14 02:58:22.518928 dv-cinder-801522-13-smb devstack@n-api.service[104248]: pcre jit disabled Oct 14 02:58:22.518928 dv-cinder-801522-13-smb devstack@n-api.service[104248]: detected number of CPU cores: 4 Oct 14 02:58:22.518928 dv-cinder-801522-13-smb devstack@n-api.service[104248]: current working directory: / Oct 14 02:58:22.518928 dv-cinder-801522-13-smb devstack@n-api.service[104248]: detected binary path: /usr/bin/uwsgi-core Oct 14 02:58:22.519627 dv-cinder-801522-13-smb devstack@n-api.service[104248]: your processes number limit is 47680 Oct 14 02:58:22.519627 dv-cinder-801522-13-smb devstack@n-api.service[104248]: your memory page size is 4096 bytes Oct 14 02:58:22.519627 dv-cinder-801522-13-smb devstack@n-api.service[104248]: detected max file descriptor number: 2048 Oct 14 02:58:22.519627 dv-cinder-801522-13-smb devstack@n-api.service[104248]: lock engine: pthread robust mutexes Oct 14 02:58:22.519627 dv-cinder-801522-13-smb devstack@n-api.service[104248]: thunder lock: enabled Oct 14 02:58:22.519627 dv-cinder-801522-13-smb devstack@n-api.service[104248]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 14 02:58:22.519627 dv-cinder-801522-13-smb devstack@n-api.service[104248]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 14 02:58:22.558097 dv-cinder-801522-13-smb devstack@n-api.service[104248]: Python main interpreter initialized at 0x564f900899c0 Oct 14 02:58:22.558097 dv-cinder-801522-13-smb devstack@n-api.service[104248]: python threads support enabled Oct 14 02:58:22.558097 dv-cinder-801522-13-smb devstack@n-api.service[104248]: your server socket listen backlog is limited to 100 connections Oct 14 02:58:22.558097 dv-cinder-801522-13-smb devstack@n-api.service[104248]: your mercy for graceful operations on workers is 90 seconds Oct 14 02:58:22.558432 dv-cinder-801522-13-smb devstack@n-api.service[104248]: mapped 403077 bytes (393 KB) for 2 cores Oct 14 02:58:22.558508 dv-cinder-801522-13-smb devstack@n-api.service[104248]: *** Operational MODE: preforking *** Oct 14 02:58:22.558768 dv-cinder-801522-13-smb devstack@n-api.service[104248]: *** uWSGI is running in multiple interpreter mode *** Oct 14 02:58:22.558768 dv-cinder-801522-13-smb devstack@n-api.service[104248]: spawned uWSGI master process (pid: 104248) Oct 14 02:58:22.558949 dv-cinder-801522-13-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 14 02:58:22.559473 dv-cinder-801522-13-smb devstack@n-api.service[104248]: spawned uWSGI worker 1 (pid: 104249, cores: 1) Oct 14 02:58:22.559804 dv-cinder-801522-13-smb devstack@n-api.service[104248]: spawned uWSGI worker 2 (pid: 104250, cores: 1) Oct 14 02:58:22.559949 dv-cinder-801522-13-smb devstack@n-api.service[104248]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 14 02:58:23.219327 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 02:58:23.222647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 02:58:24.301780 dv-cinder-801522-13-smb devstack@n-api.service[104250]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 02:58:24.301780 dv-cinder-801522-13-smb devstack@n-api.service[104250]: from cryptography.utils import int_from_bytes Oct 14 02:58:24.302420 dv-cinder-801522-13-smb devstack@n-api.service[104249]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 02:58:24.302420 dv-cinder-801522-13-smb devstack@n-api.service[104249]: from cryptography.utils import int_from_bytes Oct 14 02:58:24.302824 dv-cinder-801522-13-smb devstack@n-api.service[104250]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 02:58:24.302824 dv-cinder-801522-13-smb devstack@n-api.service[104250]: from cryptography.utils import int_from_bytes Oct 14 02:58:24.302939 dv-cinder-801522-13-smb devstack@n-api.service[104249]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 02:58:24.302939 dv-cinder-801522-13-smb devstack@n-api.service[104249]: from cryptography.utils import int_from_bytes Oct 14 02:58:26.820976 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 02:58:26.821557 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 02:58:26.821651 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 02:58:26.822005 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 02:58:26.822091 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 02:58:26.822173 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 02:58:26.822344 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 02:58:26.822450 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 02:58:26.822730 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.822819 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 02:58:26.823023 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 02:58:26.823111 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.823369 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.823458 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.823764 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.823871 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.824094 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.824449 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.824545 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.824807 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.824922 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.825126 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.825404 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.825505 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.825766 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.825913 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.826097 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.826282 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.826378 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.826557 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.826655 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.826876 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.826984 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-13-smb {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.827202 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-13-smb {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.827299 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.827529 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.827617 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.827841 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.827938 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.828153 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.828249 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.828501 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.828591 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.828810 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.828897 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.829137 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.829233 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.829445 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.829636 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.829948 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.830101 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.830260 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.830394 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.830571 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.830694 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.830887 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.831090 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.831212 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.831322 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.831518 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.831662 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.831828 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.831973 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.832148 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.832236 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.832480 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.832577 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.832806 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.832906 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.833118 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.833273 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-13-smb {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.833516 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-13-smb {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.833619 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.833833 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.833921 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.834149 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.834254 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.834464 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.834606 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.834877 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.835022 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.835191 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.835285 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.835503 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.835593 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.835826 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.835924 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.836145 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.836235 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.836475 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.836599 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.836809 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.836927 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.837126 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.837252 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.837450 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.838049 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.838558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.838741 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.838894 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.839059 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.839238 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.839419 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.839566 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.839761 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.839907 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.840066 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.840162 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.840381 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.840482 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.840720 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.840830 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.840977 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.841074 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.841293 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.841382 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.841690 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.841952 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.842206 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.842531 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.842854 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.842941 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.843339 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.843898 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.844257 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.844561 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.844751 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.845330 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.845680 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.846166 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.846537 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.846899 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.847241 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.847425 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.847797 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.848140 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.848504 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.848840 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.848941 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.849173 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.849267 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.849502 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.849594 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.849831 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.849935 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.850167 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.850251 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.850502 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.850594 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.850839 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.850937 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.851161 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.851253 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.851494 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.851697 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.851902 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.851986 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.852169 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.852262 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.852518 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.852630 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.852870 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.852956 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.853201 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.853294 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.853522 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.853623 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.853850 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.853935 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.854183 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.854284 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.854493 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.854578 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.855341 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.855442 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.855656 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.855749 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.855986 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.856079 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.856295 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.856425 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.856588 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.856692 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.856900 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.856992 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.857209 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.857292 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.857526 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.857632 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.857834 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.857933 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.858147 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.858232 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.858459 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.858560 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.858764 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.858857 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.859079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.859250 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.859408 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.859556 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.859722 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.859876 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.860029 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.860178 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.860331 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.860523 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.860672 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.860818 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.860991 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.861155 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.861321 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.861481 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.861632 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.861793 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.861950 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.862111 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.862551 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.862731 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.862853 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.862949 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.863039 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.863164 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.863268 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.863591 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.863762 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.863912 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.864011 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.864218 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.864314 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.864569 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.864656 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.864880 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.864976 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.865205 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.865305 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.865516 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.865601 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.865827 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.865919 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.866147 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.866247 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.866458 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.866547 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.866768 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.866854 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.867090 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.867176 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.867392 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.867484 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.867702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.867787 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.868014 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.868106 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.868323 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.868442 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.868659 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.868745 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.868968 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.869055 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.869278 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.869375 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.869582 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.869668 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.869890 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.869976 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.870195 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.870280 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.871079 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.871252 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.871404 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.871557 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.871700 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.871846 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.871982 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.872132 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.872290 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.872446 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.872628 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.872718 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.872944 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.873050 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.873255 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.873350 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.873572 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.873669 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.873901 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:26.873998 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.874240 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.874328 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.874558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.874654 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.874894 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.874985 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.875221 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.875307 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.875537 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.875623 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.875852 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.875941 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.876170 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.876257 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.876524 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.876625 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.876841 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.876933 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.877155 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.877244 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.877469 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.877566 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.877785 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.877872 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.878101 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.878208 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.878430 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.878518 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.878746 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.878835 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.879067 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.879155 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.879389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.879485 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.879700 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.879788 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.880024 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.880111 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.880338 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.880451 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.880691 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.880778 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.881006 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.881094 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.881337 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.881435 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.881655 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.881743 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.881985 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.882072 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.882313 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.882411 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.882637 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.882726 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.882956 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.883051 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.883268 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.883365 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.883581 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.883677 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.883895 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.883982 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.884213 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.884302 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.884550 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.884641 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.884875 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.884973 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.885191 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.885281 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.885513 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.885601 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.885827 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.885915 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.886182 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.886270 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.886522 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.886657 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.886821 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.886907 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.887132 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.887230 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.887448 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.887537 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.887764 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.887861 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.888085 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.888179 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.888417 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.888522 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.888736 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.888834 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.889056 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.889151 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.889370 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.889513 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.889682 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.889780 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.889995 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.890085 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.890300 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.890399 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.890607 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.890708 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.890912 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.891002 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.891222 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.891353 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.891524 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.891618 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.891837 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.891929 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.892150 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.892237 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.892483 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.892575 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.892823 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.892958 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.893135 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.893221 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.893449 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.893553 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.893761 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.893850 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.894074 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.894162 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.894380 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.894468 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.894694 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.894781 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.895003 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.895099 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.895308 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.895401 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.895627 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.895715 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.895934 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.896029 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.896244 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.896339 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.896590 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.896676 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.896905 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.897005 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.897214 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.897310 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.897530 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.897624 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.897837 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.897933 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.898150 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.898237 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.898464 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.898552 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.898774 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.898862 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.899093 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.899188 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.899406 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.899498 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.899722 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.899816 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.900039 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.900126 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.900359 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.900521 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.900692 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.900780 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.901019 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.901113 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.901346 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.901432 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.901693 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.901782 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.902002 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.902089 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.902313 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.902411 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.902620 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.902707 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.902929 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.903021 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.903236 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.903336 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.903545 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.903632 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.903850 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.903944 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.904157 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.904253 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.904489 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.904579 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.904797 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.904883 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.905103 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.905203 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.905412 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.905499 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.905723 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.905817 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.906031 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.906122 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.906336 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.906423 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.906641 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.906735 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.906947 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.907037 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.907257 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.907351 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.907602 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.907688 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.907912 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.908000 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.908243 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.908330 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.908594 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.908684 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.908912 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.909002 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.909229 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.909317 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.909542 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.909643 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.909856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.909955 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.910170 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.910258 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.910479 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.910576 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.910794 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.910881 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.911104 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.911190 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.911424 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.911572 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.911737 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.911825 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.912061 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.912147 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.912371 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.912489 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.912717 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.912819 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.913031 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.913122 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.913346 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.913449 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.913654 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.913749 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.913976 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.914066 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.914311 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.914406 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.914633 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.914729 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.914946 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.915033 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.915261 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.915350 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.915572 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.915668 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.915886 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.915973 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.916198 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.916286 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.916533 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.916625 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.916853 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.916983 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.917166 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.917788 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.918009 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.918112 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.918322 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.918424 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.918647 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.918735 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.918961 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.919048 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.919283 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.919378 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.919591 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.919678 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.919906 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.919992 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.920215 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.920308 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.920559 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.920649 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.920876 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.920965 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.921190 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.921292 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.921513 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.921643 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.921829 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.921918 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.922137 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.922225 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.922448 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.922542 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.922757 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.922844 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.923112 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.923216 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.923375 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.923462 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.923687 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.923776 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.924003 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.924119 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.924311 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.924422 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.924643 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.924729 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.924956 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.925044 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.925265 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.925358 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.925570 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.925656 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.925875 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.925970 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.926181 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.926273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.926491 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.926586 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.926800 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.926893 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.927123 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.927222 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.927435 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.927528 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.927736 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.927820 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.928042 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.928128 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.928365 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.928510 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.928698 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.928784 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.929003 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.929097 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.929309 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.929472 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.929617 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.929705 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.929928 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.930077 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.930243 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.930382 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.930536 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.930680 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.930851 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.930989 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.931172 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.931316 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.931480 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.931626 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.931795 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.931887 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.932105 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.932202 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.932438 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.932528 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.932757 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.932856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.933623 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.933723 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.933947 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.934035 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.934265 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.934362 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.934575 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.934670 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.934888 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.934976 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.935201 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.935297 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.935513 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.935603 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.935818 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.935904 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.936129 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.936231 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.936463 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.936555 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.936770 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.936868 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.937081 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.937216 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.937388 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.937487 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.937705 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.937959 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.938056 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.938295 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.938597 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.938686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.938918 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.939005 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.939251 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.939339 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.939570 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.939668 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.939902 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.939991 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.940231 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.940340 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.940587 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.940689 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.940900 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.940990 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.941212 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.941300 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.941518 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.941608 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.941825 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.941921 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.942136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.942223 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.942440 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.942528 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.942750 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.942847 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.943057 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.943147 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.943368 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.943455 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.943676 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.943763 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.943984 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.944073 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.944290 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.944380 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.944625 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.944714 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.944939 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.945036 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.945245 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.945333 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.945563 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.945651 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.945871 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.945969 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.946191 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.946278 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.946499 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.946586 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.946809 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.946916 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.947115 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.947204 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.947425 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.947517 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.947734 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.947830 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.948050 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.948139 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.948415 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.948518 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.948751 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.948847 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.949094 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.949191 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.949401 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.949488 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.949710 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.949807 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.950036 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.950125 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.950346 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.950442 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.950652 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.950742 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.950956 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.951044 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.951264 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.951360 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.951571 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.951659 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.951876 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.951965 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.952189 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.952285 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.952520 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.952612 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.952836 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.952923 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.953146 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.953247 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.953458 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.953545 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.953767 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.953869 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.954072 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.954239 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.954384 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.954512 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.954690 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.954777 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.954996 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.955095 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.955299 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.955389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.955606 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.955692 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.955912 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.956007 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.956217 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.956306 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.956554 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.956643 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.956860 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.956956 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.957173 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.957259 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.957478 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.957575 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.957781 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.957878 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.958085 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.958175 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.958395 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.958484 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.958701 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.958789 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.959002 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.959090 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.959316 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.959413 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.959626 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.959721 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.959930 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.960018 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.960236 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.960334 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.960573 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.960662 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.960877 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.960965 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.961181 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.961280 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.961488 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.961575 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.961800 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.961888 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.962113 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.962217 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.962418 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.962506 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.962729 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.962824 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.963036 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.963133 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.963346 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.963434 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.963650 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.963738 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.963959 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.964055 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.964285 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.964379 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.964614 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.964704 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.964920 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.965010 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.965224 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.965313 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.965527 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.965616 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.965834 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.965923 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.966145 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.966233 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.966451 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.966548 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.966759 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.966852 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.967065 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.967162 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.967375 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.967472 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.967687 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.967783 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.968034 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.968123 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.968337 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.968458 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.968676 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.968765 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.968998 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.969086 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.969315 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.969417 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.969629 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.969716 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.969944 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.970039 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.970246 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.970334 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.970563 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.970668 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.970869 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.970956 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.971181 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.971277 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.971487 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.971576 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.971792 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.971880 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.972099 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.972188 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.972445 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.972538 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.972744 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.972831 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.973063 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.973152 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.973380 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.973481 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.973703 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.973798 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.974010 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.974107 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.974319 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.974409 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.974634 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.974729 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.974942 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.975028 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.975252 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.975350 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.975561 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.975661 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.975873 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.975967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.976186 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.976273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.976518 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.976621 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.976835 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.976925 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.977148 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.977244 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.977454 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.977556 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.977768 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.977864 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.978075 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.978161 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.978378 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.978468 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.978696 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.978782 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.979003 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.979097 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.979308 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.979406 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.979617 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.979704 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.980459 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.980549 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.980774 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.980863 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.981082 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.981170 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.981394 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.981511 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.981706 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.981825 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.982137 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.982225 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.982446 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.982542 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.982759 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.982855 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.983068 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.983153 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.983382 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.983547 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.983697 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.983783 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.984000 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.984086 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.984323 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.984440 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.984660 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.984749 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.985043 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.985137 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.985356 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.985453 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.985662 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.985757 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.985966 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.986054 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.986276 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.986366 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.986579 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.986665 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.986894 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.986981 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.987201 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.987555 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.987760 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.987856 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.988065 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.988159 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.988373 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.988506 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.988717 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.988804 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.989025 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.989137 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.989354 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.989443 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.989744 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.989838 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.990078 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.990173 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.990390 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.990479 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.990758 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.990855 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.991082 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.991204 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.991408 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.991507 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.991732 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.991819 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.992040 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.992127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.992358 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.992479 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.992695 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.992785 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.993015 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.993101 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.993332 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.993432 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.993651 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.993738 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.994014 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.994116 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.994271 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.994437 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.994589 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.994677 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.994901 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.994989 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.995213 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.995303 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.996083 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.996184 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.996414 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.996529 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.996752 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.996849 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.997158 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.997247 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.997481 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.997570 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.997796 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.997884 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.998101 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.998189 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.998411 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.998511 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.998724 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.998812 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.999031 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.999119 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.999340 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.999437 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.999649 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.999737 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:26.999956 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.000043 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.000271 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.000366 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.000607 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.000742 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.000914 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.001016 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.001221 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.001324 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.001527 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.001615 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.001835 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.001922 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.002141 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.002230 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.002465 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.002561 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.002775 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.002863 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.003093 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.003182 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.003409 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.003535 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.003719 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.003806 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.004056 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.004193 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.004347 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.004455 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.004681 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.004770 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.004989 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.005080 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.005293 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.005381 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.005600 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.005694 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.005913 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.006003 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.006233 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.006320 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.006554 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.006649 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.006879 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.006967 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.007188 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.007277 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.007522 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.007628 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.007835 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.007994 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.008156 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.008251 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.008490 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.008602 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.008812 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.008903 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.009137 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.009225 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.009444 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.009534 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.009750 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.009852 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.010061 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.010150 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.010368 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.010457 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.010672 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.010805 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.010997 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.011088 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.011312 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.011619 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.011923 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.012368 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.012720 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.013071 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.013428 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.014172 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.014301 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.014627 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.014967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.015090 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.015439 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.015528 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.015771 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.016098 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.016445 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.016748 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.016847 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.017098 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.017187 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.017457 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.017572 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.017782 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.017873 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.018114 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.018212 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.018438 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.018523 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.018762 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.018848 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.019087 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.019171 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.019415 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.019519 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.019744 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.019839 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.020069 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.020164 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.020420 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.020529 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.020745 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.021019 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.021187 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.021346 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.021512 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.021679 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.021825 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.021976 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.022124 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.022269 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.022432 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.022578 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.022739 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.022884 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.023032 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.023182 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.023346 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.023493 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.023644 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.023790 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.023936 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.024066 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.024358 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.024540 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.024708 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.024856 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.025014 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.025165 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.025333 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.025484 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.025629 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.025777 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.025926 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.026099 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.026245 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.026543 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.027162 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.027431 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.027660 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.027885 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.027976 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.028058 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.028209 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.028356 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.028570 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.028742 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.028916 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.029064 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.029255 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.029375 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.029595 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.029693 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.029948 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.030037 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.030280 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.030369 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.030598 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.030695 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.030912 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.031048 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.031232 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.031322 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.031547 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.031638 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.031859 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.031949 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.032172 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.032272 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.032512 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.032641 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.032832 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.032921 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.033159 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.033265 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.033481 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.033569 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.033802 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.033890 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.034120 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.034217 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.034440 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.034529 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.034757 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.034844 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.035078 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.035273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.035402 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.035589 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.035726 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.035920 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.036058 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.036246 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.036425 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.036601 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.036753 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.036919 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.037078 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.037236 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.037403 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.037563 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.037729 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.037873 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.038181 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.038269 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.038492 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.038581 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.038802 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.038900 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.039109 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.039212 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.039432 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.039521 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.039744 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.039841 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.040050 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.040140 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.040371 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.040497 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.040703 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.040819 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.041136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.041223 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.041456 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.041569 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.041775 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.041894 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.042095 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.042228 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.042963 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.043145 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.043288 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.043470 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.043604 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.043781 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.043933 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.044108 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.044251 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.044441 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.044759 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.044857 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.045075 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.045178 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.045389 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.045484 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.045696 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.045790 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.046002 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.046097 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.046313 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.046399 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.046624 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.046711 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.046931 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.047026 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.047241 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.047336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.047546 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.047641 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.047879 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.047983 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.048186 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.048273 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.048516 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.048607 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.048825 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.048913 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.049139 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.049225 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.049447 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.049533 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.049753 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.049841 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.050062 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.050149 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.050366 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.050452 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.050679 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.050774 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.050983 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.051069 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.051295 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.051398 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.051595 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.051682 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.051905 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.051992 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.052222 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.052315 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.052560 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.052652 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.052877 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.052975 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.053192 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.053298 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.053495 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.053580 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.053802 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.053895 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.054114 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.054210 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.054426 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.054518 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.054740 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.054825 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.055056 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.055150 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.055372 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.055517 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.055696 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.055781 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.056016 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.056103 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.056326 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.056573 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.056663 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.056914 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.057011 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.057242 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.057328 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.057579 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.057666 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.057914 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.058080 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.058226 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.058313 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.058535 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.058622 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.058845 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.058946 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.059173 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.059407 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.059501 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.059748 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.059847 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.060077 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.060163 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.060475 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.060566 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.060718 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.060817 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.061030 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.061125 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.061346 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.061464 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.061656 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.061770 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.061966 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.062065 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.062275 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.062376 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.062584 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.062691 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.062893 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.062994 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.063203 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.063354 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.063504 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.063642 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.063808 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.063948 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.064124 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.064263 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.064464 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.064558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.064785 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.064901 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.065097 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.065205 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.065410 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.065505 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.065717 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.065816 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.066025 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.066129 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.066334 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.066437 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.066641 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.066736 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.066954 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.067107 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.067278 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.067420 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.067592 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.067723 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.067897 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.068040 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.068220 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.068561 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.068650 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.068881 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.068986 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.069198 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.069298 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.069515 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.069603 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.069824 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.069918 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.070148 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.070242 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.070466 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.070551 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.070776 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.070870 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.071096 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.071410 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.071517 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.071741 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.071856 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.072080 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.072176 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.072420 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.072519 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.072740 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.072842 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.073045 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.073141 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.073351 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.073457 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.073656 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.073755 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.073967 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.074064 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.074285 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.074381 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.074594 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.074686 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.074908 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.075055 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.075213 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.075345 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.075521 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.075657 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.075826 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.075957 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.076131 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.076277 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.076481 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.076617 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.076771 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.076915 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.077077 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.077221 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.077380 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.077510 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.077683 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.077818 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.077987 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.078129 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.078292 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.078380 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.078596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.078683 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.078903 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.078998 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.079213 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.079299 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.079518 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.079604 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.079822 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.079916 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.080126 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.080213 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.080451 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.080542 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.080756 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.080845 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.081064 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.081149 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.081375 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.081461 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.081689 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.081779 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.082004 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.082091 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.082313 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.082399 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.082622 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.082716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.082928 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.083013 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.083235 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.083334 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.083547 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.083645 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.083857 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.083942 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.084166 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.084260 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.084520 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.084649 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.084840 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.084927 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.085153 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.085255 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.085466 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.085554 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.085776 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.085861 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.086081 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.086175 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.086391 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.086478 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.086716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.086802 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.087029 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.087187 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.087336 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.087422 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.087659 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.087747 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.087973 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.088059 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.088291 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.088403 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.088628 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.088715 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.088942 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.089029 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.089772 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.089858 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.090087 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.090173 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.090401 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.090496 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.090711 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.090797 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.091022 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.091118 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.091334 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.091421 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.091652 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.091746 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.091965 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.092059 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.092276 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.092362 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.092637 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.092725 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.092955 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.093051 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.093272 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.093364 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.093595 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.093721 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.093901 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.093995 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.094219 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.094315 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.094544 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.094633 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.094865 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.094958 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.095187 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.095288 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.095509 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.095598 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.095834 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.095925 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.096145 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.096234 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.096481 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.096574 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.096791 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.096890 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.097035 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 02:58:27.097147 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.097481 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.097834 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.098156 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.098506 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.098840 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.099162 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.099482 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.099794 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:27.100044 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 02:58:27.249754 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO dbcounter [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Registered counter for database nova_api Oct 14 02:58:27.252655 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO dbcounter [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] Registered counter for database nova_api Oct 14 02:58:27.270491 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_db.sqlalchemy.engines [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104250) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:27.272430 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG oslo_db.sqlalchemy.engines [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104249) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:27.277708 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG dbcounter [-] [104250] Writer thread running {{(pid=104250) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:27.279472 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG dbcounter [-] [104249] Writer thread running {{(pid=104249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:27.333338 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.context [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e228678d-bf1f-4de4-9ba4-dd43fa30f246(cell1) {{(pid=104250) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 02:58:27.335735 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.context [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e228678d-bf1f-4de4-9ba4-dd43fa30f246(cell1) {{(pid=104249) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 02:58:27.337176 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 02:58:27.337645 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 02:58:27.339730 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 02:58:27.340127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG oslo_concurrency.lockutils [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 02:58:27.340476 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 02:58:27.340637 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG oslo_concurrency.lockutils [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 02:58:27.340924 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 02:58:27.342203 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG oslo_concurrency.lockutils [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 02:58:27.342875 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 02:58:27.342976 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG oslo_concurrency.lockutils [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 02:58:27.343359 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG oslo_concurrency.lockutils [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 02:58:27.344854 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO dbcounter [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Registered counter for database nova_cell0 Oct 14 02:58:27.345386 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG oslo_concurrency.lockutils [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 02:58:27.347377 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO dbcounter [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] Registered counter for database nova_cell0 Oct 14 02:58:27.348881 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO dbcounter [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Registered counter for database nova_cell1 Oct 14 02:58:27.351375 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO dbcounter [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] Registered counter for database nova_cell1 Oct 14 02:58:27.356830 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_db.sqlalchemy.engines [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104250) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:27.358430 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_db.sqlalchemy.engines [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104250) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:27.360785 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG oslo_db.sqlalchemy.engines [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104249) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:27.362744 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG oslo_db.sqlalchemy.engines [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104249) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:27.364940 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG dbcounter [-] [104250] Writer thread running {{(pid=104250) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:27.366399 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG dbcounter [-] [104250] Writer thread running {{(pid=104250) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:27.368316 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG dbcounter [-] [104249] Writer thread running {{(pid=104249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:27.373622 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG dbcounter [-] [104249] Writer thread running {{(pid=104249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:27.509327 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO dbcounter [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Registered counter for database nova_cell0 Oct 14 02:58:27.516365 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO dbcounter [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] Registered counter for database nova_cell0 Oct 14 02:58:27.516666 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_db.sqlalchemy.engines [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104250) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:27.521486 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG dbcounter [-] [104250] Writer thread running {{(pid=104250) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:27.525086 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG oslo_db.sqlalchemy.engines [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104249) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:27.530451 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG dbcounter [-] [104249] Writer thread running {{(pid=104249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:27.993087 dv-cinder-801522-13-smb devstack@n-api.service[104250]: WARNING keystonemiddleware.auth_token [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 02:58:28.000898 dv-cinder-801522-13-smb devstack@n-api.service[104250]: WARNING keystonemiddleware.auth_token [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 02:58:28.014711 dv-cinder-801522-13-smb devstack@n-api.service[104249]: WARNING keystonemiddleware.auth_token [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 02:58:28.021974 dv-cinder-801522-13-smb devstack@n-api.service[104249]: WARNING keystonemiddleware.auth_token [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 02:58:28.337946 dv-cinder-801522-13-smb devstack@n-api.service[104250]: WARNING keystonemiddleware.auth_token [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 02:58:28.343897 dv-cinder-801522-13-smb devstack@n-api.service[104250]: WARNING keystonemiddleware.auth_token [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 02:58:28.349220 dv-cinder-801522-13-smb devstack@n-api.service[104250]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564f900899c0 pid: 104250 (default app) Oct 14 02:58:28.351239 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 02:58:28.352430 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001682 Oct 14 02:58:28.352833 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Fri Oct 14 02:58:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 02:58:28.362128 dv-cinder-801522-13-smb devstack@n-api.service[104249]: WARNING keystonemiddleware.auth_token [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 02:58:28.368335 dv-cinder-801522-13-smb devstack@n-api.service[104249]: WARNING keystonemiddleware.auth_token [None req-8a02e2d5-cba5-4efa-9033-cbdd056aa922 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 02:58:28.374163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564f900899c0 pid: 104249 (default app) Oct 14 02:59:51.539012 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 02:59:51.539952 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 14 02:59:51.540346 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 931 bytes} [Fri Oct 14 02:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 02:59:51.553379 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG dbcounter [-] [104249] Writing DB stats nova_api:SELECT=3 {{(pid=104249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:51.554572 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG dbcounter [-] [104249] Writing DB stats nova_cell0:SELECT=3 {{(pid=104249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:51.555441 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG dbcounter [-] [104249] Writing DB stats nova_cell1:SELECT=3 {{(pid=104249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:51.557860 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG dbcounter [-] [104249] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:52.429959 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-6163d19f-4c5a-425f-b9f4-ea238158f417 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 02:59:52.463480 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-6163d19f-4c5a-425f-b9f4-ea238158f417 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.915890 Oct 14 02:59:52.477450 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1292 bytes} [Fri Oct 14 02:59:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 02:59:55.102326 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 02:59:55.103349 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-e32bfc17-aea3-4c5c-9544-7f663e3c643f None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 14 02:59:55.104811 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 931 bytes} [Fri Oct 14 02:59:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 02:59:55.545824 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-ae813f0a-bdb4-4759-92d6-9d84bd20ecad admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "ram": 256, "disk": 1}} {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 02:59:55.673857 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-ae813f0a-bdb4-4759-92d6-9d84bd20ecad admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.563676 Oct 14 02:59:55.674414 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Oct 14 02:59:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 02:59:55.687868 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG dbcounter [-] [104250] Writing DB stats nova_api:SELECT=3 {{(pid=104250) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:55.688791 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG dbcounter [-] [104250] Writing DB stats nova_cell1:SELECT=3 {{(pid=104250) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:55.691017 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG dbcounter [-] [104250] Writing DB stats nova_cell0:SELECT=3 {{(pid=104250) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:55.691843 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG dbcounter [-] [104250] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104250) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:55.894047 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-18ebe675-db75-4c6a-a40d-60ed2cb0949e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 02:59:56.020628 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-18ebe675-db75-4c6a-a40d-60ed2cb0949e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.337887 Oct 14 02:59:56.021222 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1336 bytes} [Fri Oct 14 02:59:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 02:59:58.609879 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-ae813f0a-bdb4-4759-92d6-9d84bd20ecad admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 02:59:58.610912 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-ae813f0a-bdb4-4759-92d6-9d84bd20ecad admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 14 02:59:58.611327 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 931 bytes} [Fri Oct 14 02:59:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 02:59:59.263037 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-151579a0-8cad-4772-84a7-152ddb2414a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "ds512M", "swap": 0, "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 02:59:59.412963 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-151579a0-8cad-4772-84a7-152ddb2414a4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.794603 Oct 14 02:59:59.413522 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Oct 14 02:59:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 02:59:59.425822 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-93d5ee77-20b5-45ce-b0a1-7a29a965cc78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 02:59:59.539561 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-93d5ee77-20b5-45ce-b0a1-7a29a965cc78 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117383 Oct 14 02:59:59.540636 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1336 bytes} [Fri Oct 14 02:59:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:00:02.140146 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-151579a0-8cad-4772-84a7-152ddb2414a4 admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:02.141199 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-151579a0-8cad-4772-84a7-152ddb2414a4 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 14 03:00:02.141635 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 931 bytes} [Fri Oct 14 03:00:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:02.554449 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-31ed971a-5c26-4077-b0a1-b38f7da72980 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:02.630317 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-31ed971a-5c26-4077-b0a1-b38f7da72980 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481678 Oct 14 03:00:02.630989 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:00:02.643131 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-d8ce81ac-5ffc-419d-b20b-1d91c8c53fac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:02.745010 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-d8ce81ac-5ffc-419d-b20b-1d91c8c53fac admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105582 Oct 14 03:00:02.745594 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1336 bytes} [Fri Oct 14 03:00:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:05.370840 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-31ed971a-5c26-4077-b0a1-b38f7da72980 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:05.371869 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-31ed971a-5c26-4077-b0a1-b38f7da72980 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 14 03:00:05.372276 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 931 bytes} [Fri Oct 14 03:00:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:05.806971 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-e5aa0a23-0589-420b-bf38-9a0b8b80e2e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "swap": 0}} {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:05.871974 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-e5aa0a23-0589-420b-bf38-9a0b8b80e2e9 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492770 Oct 14 03:00:05.872857 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:00:05.884910 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-f98e0929-572a-46dc-bb61-b89b2f62c983 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:05.988716 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-f98e0929-572a-46dc-bb61-b89b2f62c983 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106290 Oct 14 03:00:05.989396 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1336 bytes} [Fri Oct 14 03:00:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:08.637608 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-e5aa0a23-0589-420b-bf38-9a0b8b80e2e9 admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:08.638670 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-e5aa0a23-0589-420b-bf38-9a0b8b80e2e9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Oct 14 03:00:08.639106 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 931 bytes} [Fri Oct 14 03:00:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:09.043017 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-7e96f532-ed68-4a97-a992-e3c08d35abb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4}} {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:09.129970 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-7e96f532-ed68-4a97-a992-e3c08d35abb9 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.484042 Oct 14 03:00:09.130819 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 03:00:09.143250 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-369ef3c9-21f5-4289-be56-34bc1e5bbc08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:09.220066 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-369ef3c9-21f5-4289-be56-34bc1e5bbc08 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080329 Oct 14 03:00:09.220587 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1336 bytes} [Fri Oct 14 03:00:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:11.917101 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-7e96f532-ed68-4a97-a992-e3c08d35abb9 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:11.918490 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-7e96f532-ed68-4a97-a992-e3c08d35abb9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001817 Oct 14 03:00:11.919033 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 931 bytes} [Fri Oct 14 03:00:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:12.344135 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-f6ded390-bf97-41ab-9c88-a0b7ece89d90 admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:12.368691 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-f6ded390-bf97-41ab-9c88-a0b7ece89d90 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.442270 Oct 14 03:00:12.369238 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1292 bytes} [Fri Oct 14 03:00:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:00:15.049030 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-7e96f532-ed68-4a97-a992-e3c08d35abb9 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:15.050598 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-7e96f532-ed68-4a97-a992-e3c08d35abb9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 Oct 14 03:00:15.051005 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 931 bytes} [Fri Oct 14 03:00:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:15.449507 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-418a7198-25e4-489b-81fd-297313e28acc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "swap": 0, "ram": 512, "id": "1", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:15.547070 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-418a7198-25e4-489b-81fd-297313e28acc admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.489777 Oct 14 03:00:15.547679 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 03:00:15.560465 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-4cff8247-e72e-4adb-be2b-9859f6d1074f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:15.674458 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-4cff8247-e72e-4adb-be2b-9859f6d1074f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117806 Oct 14 03:00:15.675591 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1333 bytes} [Fri Oct 14 03:00:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:00:18.300834 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-418a7198-25e4-489b-81fd-297313e28acc admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:18.301838 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-418a7198-25e4-489b-81fd-297313e28acc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 14 03:00:18.302242 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 931 bytes} [Fri Oct 14 03:00:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:18.655611 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-bb1025e1-464e-4921-ac1e-ee02262dbdae admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "swap": 0}} {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:18.739598 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-bb1025e1-464e-4921-ac1e-ee02262dbdae admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.431333 Oct 14 03:00:18.740151 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 03:00:18.752259 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-e49a4397-25ff-4cb1-9cf3-f8f264b99ac7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:18.819447 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-e49a4397-25ff-4cb1-9cf3-f8f264b99ac7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070959 Oct 14 03:00:18.820062 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1333 bytes} [Fri Oct 14 03:00:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:21.418282 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-bb1025e1-464e-4921-ac1e-ee02262dbdae admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:21.419972 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-bb1025e1-464e-4921-ac1e-ee02262dbdae admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002130 Oct 14 03:00:21.420915 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 931 bytes} [Fri Oct 14 03:00:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:21.881678 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-43611943-5174-4c1b-b359-1c99179013f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:21.947299 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-43611943-5174-4c1b-b359-1c99179013f0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.519299 Oct 14 03:00:21.948121 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 03:00:21.962519 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-b956a660-e8ee-4587-99d0-9bea8c6497e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:21.968480 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG dbcounter [-] [104249] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:22.044931 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-b956a660-e8ee-4587-99d0-9bea8c6497e3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087793 Oct 14 03:00:22.045519 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1333 bytes} [Fri Oct 14 03:00:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:24.708749 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-43611943-5174-4c1b-b359-1c99179013f0 admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:24.709776 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-43611943-5174-4c1b-b359-1c99179013f0 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Oct 14 03:00:24.710181 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 931 bytes} [Fri Oct 14 03:00:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:25.153664 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-3b463166-2c99-4316-88f5-268ded5361db admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "disk": 80, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:25.235080 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-3b463166-2c99-4316-88f5-268ded5361db admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.518605 Oct 14 03:00:25.235866 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:00:25.247686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-3f415ad4-cc63-48ff-942c-7eeadaefc8ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:25.316621 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-3f415ad4-cc63-48ff-942c-7eeadaefc8ce admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072542 Oct 14 03:00:25.317205 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1333 bytes} [Fri Oct 14 03:00:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:27.913991 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-3b463166-2c99-4316-88f5-268ded5361db admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:27.914923 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-3b463166-2c99-4316-88f5-268ded5361db admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 14 03:00:27.915328 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 931 bytes} [Fri Oct 14 03:00:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:28.378067 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-bad98d6b-837d-4c28-9f7a-7df57a2f3935 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "id": "5", "swap": 0, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:28.395631 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG dbcounter [-] [104250] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104250) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:28.521505 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-bad98d6b-837d-4c28-9f7a-7df57a2f3935 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.599754 Oct 14 03:00:28.522405 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:00:28.534980 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-964bcab9-1833-46d2-98e1-ccba0d50e7ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:28.621594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-964bcab9-1833-46d2-98e1-ccba0d50e7ca admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090835 Oct 14 03:00:28.622512 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1333 bytes} [Fri Oct 14 03:00:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:45.979523 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-bad98d6b-837d-4c28-9f7a-7df57a2f3935 admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:45.981188 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-bad98d6b-837d-4c28-9f7a-7df57a2f3935 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002189 Oct 14 03:00:45.981703 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 931 bytes} [Fri Oct 14 03:00:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:45.992056 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG dbcounter [-] [104249] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:46.367921 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-62c18217-8358-4201-9af1-dc10814ba456 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:46.386467 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-62c18217-8358-4201-9af1-dc10814ba456 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398884 Oct 14 03:00:46.387007 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1292 bytes} [Fri Oct 14 03:00:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:00:47.687714 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-bad98d6b-837d-4c28-9f7a-7df57a2f3935 admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:47.688750 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-bad98d6b-837d-4c28-9f7a-7df57a2f3935 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 14 03:00:47.693052 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Oct 14 03:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:48.210509 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-240111fb-2486-4733-a5ca-20c94902eccb admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:48.215874 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.wsgi [None req-240111fb-2486-4733-a5ca-20c94902eccb admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-240111fb-2486-4733-a5ca-20c94902eccb admin admin] Request method failure captured: Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Accept: application/json Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Accept-Encoding: gzip, deflate Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Connection: keep-alive Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Content-Length: 0 Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Host: 10.222.0.13 Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Openstack-Api-Version: compute 2.92 Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Openstack-System-Scope: None Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: User-Agent: python-novaclient Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Auth-Token: gAAAAABjSNDfTDACLshf4PAt_C-9TNMbb0nsgdywAmZ-S-TujJmAcBunm94qfdCw2Ay7gGNmBJfK6TF7XY2gS9JcE-2DWoCY0oMpQ5Yhyvp0L9kzbRHSKbLu5BXrhmTSrg2X8J7Xj-y5_5xuRTL0wUc3kMf6b7LwCc4a1nftcRa2pj5yFHIeQhg Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Domain-Id: None Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Domain-Name: None Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Identity-Status: Confirmed Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Is-Admin-Project: True Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Project-Domain-Id: default Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Project-Domain-Name: Default Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Project-Id: 1ee22ef683e5495db6f46559187e0847 Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Project-Name: admin Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Role: admin,member,reader Oct 14 03:00:48.219163 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Roles: admin,member,reader Oct 14 03:00:48.221389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee22ef683e5495db6f46559187e0847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:00:48.221389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Tenant: admin Oct 14 03:00:48.221389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Tenant-Id: 1ee22ef683e5495db6f46559187e0847 Oct 14 03:00:48.221389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Tenant-Name: admin Oct 14 03:00:48.221389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User: admin Oct 14 03:00:48.221389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User-Domain-Id: default Oct 14 03:00:48.221389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User-Domain-Name: Default Oct 14 03:00:48.221389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User-Id: 139ae328324b4c2c91733b77c70a8a8b Oct 14 03:00:48.221389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User-Name: admin Oct 14 03:00:48.221389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: method: > Oct 14 03:00:48.221389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: exception: Flavor 42 could not be found. Oct 14 03:00:48.221389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: action_args: {'id': '42'} Oct 14 03:00:48.221389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:00:48.221389 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:48.222336 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:48.223810 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-240111fb-2486-4733-a5ca-20c94902eccb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:00:48.225201 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-240111fb-2486-4733-a5ca-20c94902eccb admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.388933 Oct 14 03:00:48.225201 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Fri Oct 14 03:00:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:48.231292 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-55781edc-23fa-410c-a51d-7424ab383d75 admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:48.253962 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-55781edc-23fa-410c-a51d-7424ab383d75 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026445 Oct 14 03:00:48.254530 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Fri Oct 14 03:00:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:00:48.265245 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-f49027c6-5979-4ad8-b9db-0ede41ba83d5 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:48.291754 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-f49027c6-5979-4ad8-b9db-0ede41ba83d5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030941 Oct 14 03:00:48.292318 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Fri Oct 14 03:00:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:00:48.301719 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-b75dd2f4-3a65-4f3c-a15d-d77bc6ac944d admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:48.307447 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.wsgi [None req-b75dd2f4-3a65-4f3c-a15d-d77bc6ac944d admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-b75dd2f4-3a65-4f3c-a15d-d77bc6ac944d admin admin] Request method failure captured: Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Accept: application/json Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Accept-Encoding: gzip, deflate Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Connection: keep-alive Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Content-Length: 0 Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Host: 10.222.0.13 Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Openstack-Api-Version: compute 2.92 Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Openstack-System-Scope: None Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: User-Agent: python-novaclient Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Auth-Token: gAAAAABjSNDfTDACLshf4PAt_C-9TNMbb0nsgdywAmZ-S-TujJmAcBunm94qfdCw2Ay7gGNmBJfK6TF7XY2gS9JcE-2DWoCY0oMpQ5Yhyvp0L9kzbRHSKbLu5BXrhmTSrg2X8J7Xj-y5_5xuRTL0wUc3kMf6b7LwCc4a1nftcRa2pj5yFHIeQhg Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Domain-Id: None Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Domain-Name: None Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Identity-Status: Confirmed Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Is-Admin-Project: True Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Project-Domain-Id: default Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Project-Domain-Name: Default Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Project-Id: 1ee22ef683e5495db6f46559187e0847 Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Project-Name: admin Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Role: admin,member,reader Oct 14 03:00:48.310702 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Roles: admin,member,reader Oct 14 03:00:48.312273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee22ef683e5495db6f46559187e0847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:00:48.312273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Tenant: admin Oct 14 03:00:48.312273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Tenant-Id: 1ee22ef683e5495db6f46559187e0847 Oct 14 03:00:48.312273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Tenant-Name: admin Oct 14 03:00:48.312273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User: admin Oct 14 03:00:48.312273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User-Domain-Id: default Oct 14 03:00:48.312273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User-Domain-Name: Default Oct 14 03:00:48.312273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User-Id: 139ae328324b4c2c91733b77c70a8a8b Oct 14 03:00:48.312273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User-Name: admin Oct 14 03:00:48.312273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: method: > Oct 14 03:00:48.312273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: exception: Flavor 42 could not be found. Oct 14 03:00:48.312273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: action_args: {'id': '42'} Oct 14 03:00:48.312273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:00:48.312273 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:48.313558 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:48.314869 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-b75dd2f4-3a65-4f3c-a15d-d77bc6ac944d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:00:48.316152 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-b75dd2f4-3a65-4f3c-a15d-d77bc6ac944d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013932 Oct 14 03:00:48.316152 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Fri Oct 14 03:00:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:49.510320 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-f49027c6-5979-4ad8-b9db-0ede41ba83d5 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:49.511663 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-f49027c6-5979-4ad8-b9db-0ede41ba83d5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Oct 14 03:00:49.511943 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Oct 14 03:00:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:50.043748 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-33a03af6-66e8-4828-bbc3-531b510627e0 admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:50.049423 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.wsgi [None req-33a03af6-66e8-4828-bbc3-531b510627e0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-33a03af6-66e8-4828-bbc3-531b510627e0 admin admin] Request method failure captured: Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Accept: application/json Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Accept-Encoding: gzip, deflate Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Connection: keep-alive Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Content-Length: 0 Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Host: 10.222.0.13 Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Openstack-Api-Version: compute 2.92 Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Openstack-System-Scope: None Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: User-Agent: python-novaclient Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Auth-Token: gAAAAABjSNDhJSaIBFDE97iYtowTTBCglwD7ZfY8nTvRUqyY2RPtSPokiDqUjSjg1UNMtKgvUONrr4mD92FRDB5DeY5qxaCJAtSG0tKC19qHF5YyT5xha9b-LKSfoneh_0IDsPqx9v3LHQ_pZ2Abup6mkRcBVnH_lMk9-1tG3YTCtUXuiB-SJTY Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Domain-Id: None Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Domain-Name: None Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Identity-Status: Confirmed Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Is-Admin-Project: True Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Project-Domain-Id: default Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Project-Domain-Name: Default Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Project-Id: 1ee22ef683e5495db6f46559187e0847 Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Project-Name: admin Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Role: admin,member,reader Oct 14 03:00:50.050977 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Roles: admin,member,reader Oct 14 03:00:50.052590 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee22ef683e5495db6f46559187e0847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:00:50.052590 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Tenant: admin Oct 14 03:00:50.052590 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Tenant-Id: 1ee22ef683e5495db6f46559187e0847 Oct 14 03:00:50.052590 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Tenant-Name: admin Oct 14 03:00:50.052590 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User: admin Oct 14 03:00:50.052590 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User-Domain-Id: default Oct 14 03:00:50.052590 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User-Domain-Name: Default Oct 14 03:00:50.052590 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User-Id: 139ae328324b4c2c91733b77c70a8a8b Oct 14 03:00:50.052590 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User-Name: admin Oct 14 03:00:50.052590 dv-cinder-801522-13-smb devstack@n-api.service[104250]: method: > Oct 14 03:00:50.052590 dv-cinder-801522-13-smb devstack@n-api.service[104250]: exception: Flavor 84 could not be found. Oct 14 03:00:50.052590 dv-cinder-801522-13-smb devstack@n-api.service[104250]: action_args: {'id': '84'} Oct 14 03:00:50.052590 dv-cinder-801522-13-smb devstack@n-api.service[104250]: {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:00:50.052590 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:50.056856 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:50.057947 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-33a03af6-66e8-4828-bbc3-531b510627e0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:00:50.058991 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-33a03af6-66e8-4828-bbc3-531b510627e0 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.394095 Oct 14 03:00:50.058991 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Fri Oct 14 03:00:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:50.062565 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-1d869bff-1e10-47d9-a87c-4fa65792665d admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:50.077650 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-1d869bff-1e10-47d9-a87c-4fa65792665d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018804 Oct 14 03:00:50.078193 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Fri Oct 14 03:00:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:00:50.087811 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-b7b5d93a-f780-4242-a34a-c2f141df8d4a admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:50.103745 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-b7b5d93a-f780-4242-a34a-c2f141df8d4a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019414 Oct 14 03:00:50.104266 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Fri Oct 14 03:00:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:00:50.114504 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-25d1eeea-6202-43d1-b410-29c890e0c46c admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:50.119541 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.wsgi [None req-25d1eeea-6202-43d1-b410-29c890e0c46c admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-25d1eeea-6202-43d1-b410-29c890e0c46c admin admin] Request method failure captured: Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Accept: application/json Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Accept-Encoding: gzip, deflate Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Connection: keep-alive Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Content-Length: 0 Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Host: 10.222.0.13 Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Openstack-Api-Version: compute 2.92 Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Openstack-System-Scope: None Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: User-Agent: python-novaclient Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Auth-Token: gAAAAABjSNDhJSaIBFDE97iYtowTTBCglwD7ZfY8nTvRUqyY2RPtSPokiDqUjSjg1UNMtKgvUONrr4mD92FRDB5DeY5qxaCJAtSG0tKC19qHF5YyT5xha9b-LKSfoneh_0IDsPqx9v3LHQ_pZ2Abup6mkRcBVnH_lMk9-1tG3YTCtUXuiB-SJTY Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Domain-Id: None Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Domain-Name: None Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Identity-Status: Confirmed Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Is-Admin-Project: True Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Project-Domain-Id: default Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Project-Domain-Name: Default Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Project-Id: 1ee22ef683e5495db6f46559187e0847 Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Project-Name: admin Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Role: admin,member,reader Oct 14 03:00:50.121079 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Roles: admin,member,reader Oct 14 03:00:50.122647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee22ef683e5495db6f46559187e0847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:00:50.122647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Tenant: admin Oct 14 03:00:50.122647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Tenant-Id: 1ee22ef683e5495db6f46559187e0847 Oct 14 03:00:50.122647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Tenant-Name: admin Oct 14 03:00:50.122647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User: admin Oct 14 03:00:50.122647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User-Domain-Id: default Oct 14 03:00:50.122647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User-Domain-Name: Default Oct 14 03:00:50.122647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User-Id: 139ae328324b4c2c91733b77c70a8a8b Oct 14 03:00:50.122647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User-Name: admin Oct 14 03:00:50.122647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: method: > Oct 14 03:00:50.122647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: exception: Flavor 84 could not be found. Oct 14 03:00:50.122647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: action_args: {'id': '84'} Oct 14 03:00:50.122647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:00:50.122647 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:50.123594 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:50.124749 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-25d1eeea-6202-43d1-b410-29c890e0c46c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:00:50.125739 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-25d1eeea-6202-43d1-b410-29c890e0c46c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012148 Oct 14 03:00:50.125739 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Fri Oct 14 03:00:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:51.327060 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-b7b5d93a-f780-4242-a34a-c2f141df8d4a admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:51.328079 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-b7b5d93a-f780-4242-a34a-c2f141df8d4a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 14 03:00:51.328530 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Oct 14 03:00:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:51.851370 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-4f07520d-d62d-420d-9caa-802f52fdbb38 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:51.857479 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.wsgi [None req-4f07520d-d62d-420d-9caa-802f52fdbb38 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-4f07520d-d62d-420d-9caa-802f52fdbb38 admin admin] Request method failure captured: Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Accept: application/json Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Accept-Encoding: gzip, deflate Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Connection: keep-alive Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Content-Length: 0 Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Host: 10.222.0.13 Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Openstack-Api-Version: compute 2.92 Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Openstack-System-Scope: None Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: User-Agent: python-novaclient Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Auth-Token: gAAAAABjSNDjnu2C4Sr5qOpRqYfuf8BUHbecUlfuQv9d8unWsd1yhCOo0NpXWazl5uXHt3CEq45CN3acH7lXWGydvLkTStSdlSmST456Cyxf42ybq5grhhGdfdaPeRp1Me34ShzBDamiZuI3vvecASlUENRiyrVgV4yWDYa00yheh8yMJZWZEKk Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Domain-Id: None Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Domain-Name: None Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Identity-Status: Confirmed Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Is-Admin-Project: True Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Project-Domain-Id: default Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Project-Domain-Name: Default Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Project-Id: 1ee22ef683e5495db6f46559187e0847 Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Project-Name: admin Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Role: admin,member,reader Oct 14 03:00:51.858967 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Roles: admin,member,reader Oct 14 03:00:51.861136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee22ef683e5495db6f46559187e0847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:00:51.861136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Tenant: admin Oct 14 03:00:51.861136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Tenant-Id: 1ee22ef683e5495db6f46559187e0847 Oct 14 03:00:51.861136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-Tenant-Name: admin Oct 14 03:00:51.861136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User: admin Oct 14 03:00:51.861136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User-Domain-Id: default Oct 14 03:00:51.861136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User-Domain-Name: Default Oct 14 03:00:51.861136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User-Id: 139ae328324b4c2c91733b77c70a8a8b Oct 14 03:00:51.861136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: X-User-Name: admin Oct 14 03:00:51.861136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: method: > Oct 14 03:00:51.861136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: exception: Flavor 451 could not be found. Oct 14 03:00:51.861136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: action_args: {'id': '451'} Oct 14 03:00:51.861136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:00:51.861136 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:51.862127 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: ERROR nova.api.openstack.wsgi Oct 14 03:00:51.863413 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-4f07520d-d62d-420d-9caa-802f52fdbb38 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:00:51.864758 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-4f07520d-d62d-420d-9caa-802f52fdbb38 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394094 Oct 14 03:00:51.864758 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Fri Oct 14 03:00:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:51.870795 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-637e6531-4b32-4006-a24e-a2181d9e6b8a admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:51.886338 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-637e6531-4b32-4006-a24e-a2181d9e6b8a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019105 Oct 14 03:00:51.886926 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Fri Oct 14 03:00:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:00:51.896253 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-861f699a-52ff-4307-ae2d-c5d2f4a98ed6 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:51.910763 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-861f699a-52ff-4307-ae2d-c5d2f4a98ed6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018006 Oct 14 03:00:51.911278 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Fri Oct 14 03:00:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:00:51.920112 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-91de0529-b558-4771-afab-e41a8f693373 admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:51.925609 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.wsgi [None req-91de0529-b558-4771-afab-e41a8f693373 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-91de0529-b558-4771-afab-e41a8f693373 admin admin] Request method failure captured: Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Accept: application/json Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Accept-Encoding: gzip, deflate Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Connection: keep-alive Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Content-Length: 0 Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Host: 10.222.0.13 Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Openstack-Api-Version: compute 2.92 Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Openstack-System-Scope: None Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: User-Agent: python-novaclient Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Auth-Token: gAAAAABjSNDjnu2C4Sr5qOpRqYfuf8BUHbecUlfuQv9d8unWsd1yhCOo0NpXWazl5uXHt3CEq45CN3acH7lXWGydvLkTStSdlSmST456Cyxf42ybq5grhhGdfdaPeRp1Me34ShzBDamiZuI3vvecASlUENRiyrVgV4yWDYa00yheh8yMJZWZEKk Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Domain-Id: None Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Domain-Name: None Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Identity-Status: Confirmed Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Is-Admin-Project: True Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Project-Domain-Id: default Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Project-Domain-Name: Default Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Project-Id: 1ee22ef683e5495db6f46559187e0847 Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Project-Name: admin Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Role: admin,member,reader Oct 14 03:00:51.927110 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Roles: admin,member,reader Oct 14 03:00:51.928716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee22ef683e5495db6f46559187e0847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee22ef683e5495db6f46559187e0847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:00:51.928716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Tenant: admin Oct 14 03:00:51.928716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Tenant-Id: 1ee22ef683e5495db6f46559187e0847 Oct 14 03:00:51.928716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-Tenant-Name: admin Oct 14 03:00:51.928716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User: admin Oct 14 03:00:51.928716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User-Domain-Id: default Oct 14 03:00:51.928716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User-Domain-Name: Default Oct 14 03:00:51.928716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User-Id: 139ae328324b4c2c91733b77c70a8a8b Oct 14 03:00:51.928716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: X-User-Name: admin Oct 14 03:00:51.928716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: method: > Oct 14 03:00:51.928716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: exception: Flavor 451 could not be found. Oct 14 03:00:51.928716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: action_args: {'id': '451'} Oct 14 03:00:51.928716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:00:51.928716 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:51.929686 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: ERROR nova.api.openstack.wsgi Oct 14 03:00:51.931596 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-91de0529-b558-4771-afab-e41a8f693373 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104250) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:00:51.932845 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-91de0529-b558-4771-afab-e41a8f693373 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011810 Oct 14 03:00:51.932845 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Fri Oct 14 03:00:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 14 03:00:53.137748 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-861f699a-52ff-4307-ae2d-c5d2f4a98ed6 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:53.138775 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-861f699a-52ff-4307-ae2d-c5d2f4a98ed6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 14 03:00:53.139183 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Oct 14 03:00:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:53.657707 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-4df1f71d-2f79-4452-9fbd-0c07d665fae4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:53.761382 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-4df1f71d-2f79-4452-9fbd-0c07d665fae4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.484047 Oct 14 03:00:53.761939 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Fri Oct 14 03:00:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:00:54.956433 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-861f699a-52ff-4307-ae2d-c5d2f4a98ed6 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:54.957476 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-861f699a-52ff-4307-ae2d-c5d2f4a98ed6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 14 03:00:54.957871 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Oct 14 03:00:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:55.471037 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-c27b7646-56a0-4c26-8c1f-d9de3bfba8ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:55.566690 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-c27b7646-56a0-4c26-8c1f-d9de3bfba8ab admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.474810 Oct 14 03:00:55.567150 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Fri Oct 14 03:00:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:00:56.767558 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-861f699a-52ff-4307-ae2d-c5d2f4a98ed6 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:56.768621 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-861f699a-52ff-4307-ae2d-c5d2f4a98ed6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 14 03:00:56.769017 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Oct 14 03:00:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:57.278929 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-4a828eb1-2b69-497a-bc08-9bf8c1285701 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:57.375991 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-4a828eb1-2b69-497a-bc08-9bf8c1285701 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.471678 Oct 14 03:00:57.376550 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Fri Oct 14 03:00:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:00:58.578478 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-861f699a-52ff-4307-ae2d-c5d2f4a98ed6 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:58.579615 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-861f699a-52ff-4307-ae2d-c5d2f4a98ed6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Oct 14 03:00:58.580024 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Oct 14 03:00:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:59.093428 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-36c13417-e8c7-48ab-9480-54bf7588ff2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:59.166134 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-36c13417-e8c7-48ab-9480-54bf7588ff2b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.448312 Oct 14 03:00:59.166610 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Fri Oct 14 03:00:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:01:00.374713 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-861f699a-52ff-4307-ae2d-c5d2f4a98ed6 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:01:00.376250 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-861f699a-52ff-4307-ae2d-c5d2f4a98ed6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001958 Oct 14 03:01:00.376686 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Oct 14 03:01:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:01:00.896104 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-602c2dde-82c8-472e-a669-53b4bff091dc admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:01:00.915920 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-602c2dde-82c8-472e-a669-53b4bff091dc admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402706 Oct 14 03:01:00.916463 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Fri Oct 14 03:01:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:01:56.849491 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-861f699a-52ff-4307-ae2d-c5d2f4a98ed6 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:01:56.850428 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-861f699a-52ff-4307-ae2d-c5d2f4a98ed6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 14 03:01:56.850826 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 931 bytes} [Fri Oct 14 03:01:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:01:56.862166 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG dbcounter [-] [104250] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104250) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:57.236621 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-a37b0617-80db-40ea-8d15-e607857d32d1 admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:01:57.256644 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-a37b0617-80db-40ea-8d15-e607857d32d1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399496 Oct 14 03:01:57.257176 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1292 bytes} [Fri Oct 14 03:01:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:01:57.278064 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG dbcounter [-] [104249] Writing DB stats nova_api:SELECT=14 {{(pid=104249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:57.282345 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-6bd25d9e-3c14-498c-a2fc-a954539e4ec2 admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:01:57.289416 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-6bd25d9e-3c14-498c-a2fc-a954539e4ec2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012805 Oct 14 03:01:57.289928 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1283 bytes} [Fri Oct 14 03:01:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:01:57.301755 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-48633f34-1896-4a69-8943-f94c0570a367 admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:01:57.308957 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-48633f34-1896-4a69-8943-f94c0570a367 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011109 Oct 14 03:01:57.309473 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1286 bytes} [Fri Oct 14 03:01:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:01:57.321504 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-581561a0-2c03-4459-98e2-cedcfc0f281f admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:01:57.329228 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-581561a0-2c03-4459-98e2-cedcfc0f281f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011679 Oct 14 03:01:57.329752 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1286 bytes} [Fri Oct 14 03:01:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:01:57.341327 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-a1dcf639-2316-4ac5-93b5-d5fa57a01bef admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:01:57.348677 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-a1dcf639-2316-4ac5-93b5-d5fa57a01bef admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011045 Oct 14 03:01:57.349192 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1283 bytes} [Fri Oct 14 03:01:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:05:33.355297 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-581561a0-2c03-4459-98e2-cedcfc0f281f admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:33.356302 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-581561a0-2c03-4459-98e2-cedcfc0f281f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 14 03:05:33.356726 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Oct 14 03:05:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:05:33.496906 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG dbcounter [-] [104250] Writing DB stats nova_api:SELECT=6 {{(pid=104250) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:05:33.635621 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-ad911a6c-e0a4-469a-aa35-3e7c4a57e5ce admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:33.640967 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-ad911a6c-e0a4-469a-aa35-3e7c4a57e5ce admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:33.641449 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-ad911a6c-e0a4-469a-aa35-3e7c4a57e5ce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:33.641884 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-ad911a6c-e0a4-469a-aa35-3e7c4a57e5ce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:33.642600 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-ad911a6c-e0a4-469a-aa35-3e7c4a57e5ce admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:33.643053 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-ad911a6c-e0a4-469a-aa35-3e7c4a57e5ce admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:33.643480 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-ad911a6c-e0a4-469a-aa35-3e7c4a57e5ce admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:33.674708 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-ad911a6c-e0a4-469a-aa35-3e7c4a57e5ce admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 788 microversion: 2.92 time: 0.179012 Oct 14 03:05:33.675272 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Fri Oct 14 03:05:33 2022] GET /compute/v2.1/os-services => generated 788 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 03:05:34.751233 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-581561a0-2c03-4459-98e2-cedcfc0f281f admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:34.752267 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-581561a0-2c03-4459-98e2-cedcfc0f281f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 14 03:05:34.752696 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Oct 14 03:05:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:05:34.946694 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-321e1f5a-97f1-46a3-b935-7af11691b719 admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:34.950098 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-321e1f5a-97f1-46a3-b935-7af11691b719 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:34.950603 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-321e1f5a-97f1-46a3-b935-7af11691b719 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:34.951353 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-321e1f5a-97f1-46a3-b935-7af11691b719 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:34.951918 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-321e1f5a-97f1-46a3-b935-7af11691b719 admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:34.952373 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-321e1f5a-97f1-46a3-b935-7af11691b719 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:34.953269 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-321e1f5a-97f1-46a3-b935-7af11691b719 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:34.972879 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-321e1f5a-97f1-46a3-b935-7af11691b719 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 788 microversion: 2.92 time: 0.077986 Oct 14 03:05:34.973809 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Fri Oct 14 03:05:34 2022] GET /compute/v2.1/os-services => generated 788 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:05:46.434403 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-581561a0-2c03-4459-98e2-cedcfc0f281f admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:46.435453 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-581561a0-2c03-4459-98e2-cedcfc0f281f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 14 03:05:46.435850 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Oct 14 03:05:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:05:46.577286 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG dbcounter [-] [104250] Writing DB stats nova_cell0:SELECT=4 {{(pid=104250) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:05:46.578043 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG dbcounter [-] [104250] Writing DB stats nova_cell1:SELECT=4 {{(pid=104250) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:05:46.578666 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG dbcounter [-] [104250] Writing DB stats nova_api:SELECT=8 {{(pid=104250) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:05:46.626647 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-e010dfb0-4fa2-415a-8555-4ab8fda809d8 admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:46.630059 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-e010dfb0-4fa2-415a-8555-4ab8fda809d8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:46.630530 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-e010dfb0-4fa2-415a-8555-4ab8fda809d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:46.630955 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-e010dfb0-4fa2-415a-8555-4ab8fda809d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:46.631666 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-e010dfb0-4fa2-415a-8555-4ab8fda809d8 admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:46.632103 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-e010dfb0-4fa2-415a-8555-4ab8fda809d8 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:46.632610 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-e010dfb0-4fa2-415a-8555-4ab8fda809d8 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:46.658976 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-e010dfb0-4fa2-415a-8555-4ab8fda809d8 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1008 microversion: 2.92 time: 0.086150 Oct 14 03:05:46.659536 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Fri Oct 14 03:05:46 2022] GET /compute/v2.1/os-services => generated 1008 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:05:47.736220 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG nova.api.openstack.wsgi [None req-581561a0-2c03-4459-98e2-cedcfc0f281f admin admin] Calling method '>' {{(pid=104249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:47.739663 dv-cinder-801522-13-smb devstack@n-api.service[104249]: INFO nova.api.openstack.requestlog [None req-581561a0-2c03-4459-98e2-cedcfc0f281f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 14 03:05:47.739663 dv-cinder-801522-13-smb devstack@n-api.service[104249]: [pid: 104249|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Oct 14 03:05:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:05:47.928013 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG nova.api.openstack.wsgi [None req-0a394cdf-e25c-4ca6-ac1c-ebe959d00908 admin admin] Calling method '>' {{(pid=104250) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:47.931343 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-0a394cdf-e25c-4ca6-ac1c-ebe959d00908 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:47.931821 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-0a394cdf-e25c-4ca6-ac1c-ebe959d00908 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:47.932243 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-0a394cdf-e25c-4ca6-ac1c-ebe959d00908 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:47.932975 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-0a394cdf-e25c-4ca6-ac1c-ebe959d00908 admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:47.933474 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-0a394cdf-e25c-4ca6-ac1c-ebe959d00908 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:47.933829 dv-cinder-801522-13-smb devstack@n-api.service[104250]: DEBUG oslo_concurrency.lockutils [None req-0a394cdf-e25c-4ca6-ac1c-ebe959d00908 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104250) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:47.955015 dv-cinder-801522-13-smb devstack@n-api.service[104250]: INFO nova.api.openstack.requestlog [None req-0a394cdf-e25c-4ca6-ac1c-ebe959d00908 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1008 microversion: 2.92 time: 0.077968 Oct 14 03:05:47.955546 dv-cinder-801522-13-smb devstack@n-api.service[104250]: [pid: 104250|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Fri Oct 14 03:05:47 2022] GET /compute/v2.1/os-services => generated 1008 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:06:46.698081 dv-cinder-801522-13-smb systemd[1]: Stopping Devstack devstack@n-api.service... Oct 14 03:06:46.698622 dv-cinder-801522-13-smb devstack@n-api.service[104248]: Fri Oct 14 03:06:46 2022 - graceful shutdown triggered... Oct 14 03:06:46.699058 dv-cinder-801522-13-smb devstack@n-api.service[104249]: Gracefully killing worker 1 (pid: 104249)... Oct 14 03:06:46.699419 dv-cinder-801522-13-smb devstack@n-api.service[104250]: Gracefully killing worker 2 (pid: 104250)... Oct 14 03:06:46.825362 dv-cinder-801522-13-smb devstack@n-api.service[104249]: DEBUG dbcounter [-] [104249] Writing DB stats nova_api:SELECT=4 {{(pid=104249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:06:47.699755 dv-cinder-801522-13-smb devstack@n-api.service[104248]: worker 1 buried after 1 seconds Oct 14 03:06:47.699755 dv-cinder-801522-13-smb devstack@n-api.service[104248]: worker 2 buried after 1 seconds Oct 14 03:06:47.700365 dv-cinder-801522-13-smb devstack@n-api.service[104248]: goodbye to uWSGI. Oct 14 03:06:47.701290 dv-cinder-801522-13-smb systemd[1]: devstack@n-api.service: Succeeded. Oct 14 03:06:47.701843 dv-cinder-801522-13-smb systemd[1]: Stopped Devstack devstack@n-api.service. Oct 14 03:06:47.704671 dv-cinder-801522-13-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 14 03:06:47.716856 dv-cinder-801522-13-smb devstack@n-api.service[119285]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 14 03:06:47.718886 dv-cinder-801522-13-smb devstack@n-api.service[119285]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 14 03:06:47 2022] *** Oct 14 03:06:47.718886 dv-cinder-801522-13-smb devstack@n-api.service[119285]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 14 03:06:47.718886 dv-cinder-801522-13-smb devstack@n-api.service[119285]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 14 03:06:47.718886 dv-cinder-801522-13-smb devstack@n-api.service[119285]: nodename: dv-cinder-801522-13-smb Oct 14 03:06:47.718886 dv-cinder-801522-13-smb devstack@n-api.service[119285]: machine: x86_64 Oct 14 03:06:47.718886 dv-cinder-801522-13-smb devstack@n-api.service[119285]: clock source: unix Oct 14 03:06:47.718886 dv-cinder-801522-13-smb devstack@n-api.service[119285]: pcre jit disabled Oct 14 03:06:47.718886 dv-cinder-801522-13-smb devstack@n-api.service[119285]: detected number of CPU cores: 4 Oct 14 03:06:47.718886 dv-cinder-801522-13-smb devstack@n-api.service[119285]: current working directory: / Oct 14 03:06:47.718886 dv-cinder-801522-13-smb devstack@n-api.service[119285]: detected binary path: /usr/bin/uwsgi-core Oct 14 03:06:47.718886 dv-cinder-801522-13-smb devstack@n-api.service[119285]: your processes number limit is 47680 Oct 14 03:06:47.718886 dv-cinder-801522-13-smb devstack@n-api.service[119285]: your memory page size is 4096 bytes Oct 14 03:06:47.718886 dv-cinder-801522-13-smb devstack@n-api.service[119285]: detected max file descriptor number: 2048 Oct 14 03:06:47.718886 dv-cinder-801522-13-smb devstack@n-api.service[119285]: lock engine: pthread robust mutexes Oct 14 03:06:47.719836 dv-cinder-801522-13-smb devstack@n-api.service[119285]: thunder lock: enabled Oct 14 03:06:47.719836 dv-cinder-801522-13-smb devstack@n-api.service[119285]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 14 03:06:47.719836 dv-cinder-801522-13-smb devstack@n-api.service[119285]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 14 03:06:47.760348 dv-cinder-801522-13-smb devstack@n-api.service[119285]: Python main interpreter initialized at 0x562cd8f659c0 Oct 14 03:06:47.760348 dv-cinder-801522-13-smb devstack@n-api.service[119285]: python threads support enabled Oct 14 03:06:47.760348 dv-cinder-801522-13-smb devstack@n-api.service[119285]: your server socket listen backlog is limited to 100 connections Oct 14 03:06:47.760348 dv-cinder-801522-13-smb devstack@n-api.service[119285]: your mercy for graceful operations on workers is 90 seconds Oct 14 03:06:47.760825 dv-cinder-801522-13-smb devstack@n-api.service[119285]: mapped 403077 bytes (393 KB) for 2 cores Oct 14 03:06:47.760825 dv-cinder-801522-13-smb devstack@n-api.service[119285]: *** Operational MODE: preforking *** Oct 14 03:06:47.761088 dv-cinder-801522-13-smb devstack@n-api.service[119285]: *** uWSGI is running in multiple interpreter mode *** Oct 14 03:06:47.761088 dv-cinder-801522-13-smb devstack@n-api.service[119285]: spawned uWSGI master process (pid: 119285) Oct 14 03:06:47.761294 dv-cinder-801522-13-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 14 03:06:47.768439 dv-cinder-801522-13-smb devstack@n-api.service[119285]: spawned uWSGI worker 1 (pid: 119301, cores: 1) Oct 14 03:06:47.768439 dv-cinder-801522-13-smb devstack@n-api.service[119285]: spawned uWSGI worker 2 (pid: 119302, cores: 1) Oct 14 03:06:47.768439 dv-cinder-801522-13-smb devstack@n-api.service[119285]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 14 03:06:48.421887 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 03:06:48.431152 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 03:06:49.609061 dv-cinder-801522-13-smb devstack@n-api.service[119302]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 03:06:49.609061 dv-cinder-801522-13-smb devstack@n-api.service[119302]: from cryptography.utils import int_from_bytes Oct 14 03:06:49.609640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 03:06:49.609640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: from cryptography.utils import int_from_bytes Oct 14 03:06:49.615093 dv-cinder-801522-13-smb devstack@n-api.service[119301]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 03:06:49.615093 dv-cinder-801522-13-smb devstack@n-api.service[119301]: from cryptography.utils import int_from_bytes Oct 14 03:06:49.615572 dv-cinder-801522-13-smb devstack@n-api.service[119301]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 03:06:49.615572 dv-cinder-801522-13-smb devstack@n-api.service[119301]: from cryptography.utils import int_from_bytes Oct 14 03:06:51.994739 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 03:06:51.995301 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 03:06:51.995589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 03:06:51.995815 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 03:06:51.996077 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 03:06:51.996497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:51.996825 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:51.997150 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:51.997471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:51.997806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:51.998121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:51.998448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:51.998773 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:51.999104 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:51.999366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:51.999690 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.000188 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-13-smb {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.000548 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.000862 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.001202 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.001506 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.001815 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.002144 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.002470 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.002983 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.004365 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.004365 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.004365 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.004365 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.004742 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.004999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.005324 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.005645 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.005979 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.006284 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.006696 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-13-smb {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.007018 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.007329 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.007645 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.008069 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.008422 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.008728 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.009040 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.009364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.010206 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.010547 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.010864 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.011195 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.011513 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.011820 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.012131 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.012467 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.012795 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.013117 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.013410 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.013663 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.013970 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.014295 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.014616 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.014944 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.015196 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.015449 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.015769 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.016091 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.016425 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.016733 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.017039 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.019800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.019800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.019800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.019800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.019800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.019800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.019800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.019800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.020379 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.020379 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.020586 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.020670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.020990 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.021334 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.021653 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.021961 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.022284 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.022608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.022915 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.023225 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.023529 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.023861 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.024191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.024496 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 03:06:52.024926 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.024926 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.025058 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 03:06:52.025150 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.025952 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 03:06:52.026054 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.026218 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.026527 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.026836 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.027147 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.027467 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.027751 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.029014 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.029135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 03:06:52.029230 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.029306 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 03:06:52.030823 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.030920 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.031011 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.031011 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.031011 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.031225 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.031303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.031407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.031481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.031481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.031646 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.033263 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.033263 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.033263 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.033707 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.033861 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.034010 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.034152 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.034381 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.034533 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.034676 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.034828 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.034828 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.035112 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.035112 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.035426 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.035578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.035757 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.035757 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.036048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-13-smb {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.036206 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.036348 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.036543 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.036703 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.036884 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.037031 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.037182 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.037332 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.037494 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.037494 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.037780 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.037982 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.038132 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.038281 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.038423 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.038570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.038570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.038854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.039022 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.039361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.039518 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.039668 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.039817 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.039968 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.040117 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.040258 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.040454 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.040613 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.040775 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.040918 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.041067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.041216 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.041368 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.041510 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.041660 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.041809 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.041959 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.042101 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.042242 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.042391 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-13-smb {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.042542 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.042684 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.042824 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.043228 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.043393 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.044457 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.044615 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.044767 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.044909 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.045060 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.045211 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.045360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.045510 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.045661 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.045802 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.045950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.046107 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.046261 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.046410 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.046558 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.046708 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.046857 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.047008 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.047151 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.047301 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.047442 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.047582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.047731 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.047873 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.048036 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.048180 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.048321 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.048498 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.048659 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.048812 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.048960 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.049108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.049250 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.049390 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.049540 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.049681 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.049821 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.049980 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.050129 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.050271 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.050421 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.050563 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.050710 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.050710 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.051096 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.051251 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.051404 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.051546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.051687 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.051839 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.051983 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.052289 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.052460 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.052609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.052765 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.052915 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.053086 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.053414 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.053565 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.054039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.054223 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.054613 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.054780 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.054924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.055075 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.055225 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.055367 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.055509 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.055798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.055963 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.056115 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.056264 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.056432 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.056642 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.056825 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.056970 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.057111 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.057259 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.057408 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.057565 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.057707 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.057856 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.057997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.058138 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.058278 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.058431 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.058573 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.058726 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.058867 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.059007 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.059158 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.059318 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.059459 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.059607 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.059757 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.059908 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.060056 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.060206 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.060355 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.060533 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.060687 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.060837 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.060978 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.061133 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.061285 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.061435 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.061435 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.061709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.061866 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.062016 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.062016 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.062283 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.062441 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.062583 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.062583 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.062860 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.063000 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.063148 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.063484 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.063637 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.064075 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.064230 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.064709 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.064879 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.065023 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.065182 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.065411 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.065556 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.065704 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.065844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.065986 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.066143 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.066294 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.066445 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.066593 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.066735 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.066876 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.067017 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.067180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.067336 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.067485 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.067635 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.067822 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.067969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.068120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.068270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.068438 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.068586 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.068740 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.068890 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.069074 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.069226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.069367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.069521 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.069711 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.069856 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.069996 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.070177 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.070332 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.070484 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.070633 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.070839 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.070981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.071140 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.071283 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.071433 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.071582 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.071731 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.071872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.072011 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.072676 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.072838 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.072980 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.073128 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.073291 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.073626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.073803 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.074218 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.074368 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.074517 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.074909 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.075072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.075232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.075381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.075524 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.075663 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.075803 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.075953 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.076108 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.076261 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.076462 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.076625 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.076767 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.076922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.077064 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.077205 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.077352 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.077494 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.077635 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.077789 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.077931 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.078079 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.078238 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.078387 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.078529 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.078679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.078821 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:52.079319 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.079471 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.079615 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.079763 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.079921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.080806 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.080969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.081122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.081277 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.081430 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.081582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.081726 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.081868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.082588 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.082754 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.082909 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.083836 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.084005 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.084524 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.084685 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.085374 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.085530 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.085687 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.085847 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.086001 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.086151 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.086302 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.086452 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.086594 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.087577 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.087735 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.087938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.088616 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.088773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.088925 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.089092 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.089242 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.089386 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.089535 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.089677 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.089818 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.089973 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.090126 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.090269 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.090428 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.090571 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.090722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.090873 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.091022 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.091166 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.091307 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.091455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.091607 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.091750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.091891 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.092038 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.092181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.092332 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.092524 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.092670 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.092810 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.092959 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.093114 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.093270 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.093422 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.093642 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.093962 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.094112 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.094596 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.094774 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.094938 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.095158 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.095331 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.095674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.095889 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.096063 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.096208 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.096349 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.096560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.096702 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.096842 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.097303 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.097483 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.097636 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.097778 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.097917 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.098074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.098226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.098475 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.098576 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.098653 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.098725 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.098806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.098887 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.098967 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.098967 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.099123 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.099202 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.099202 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.099355 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.099439 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.099519 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.099602 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.099680 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.099778 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.099917 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.100009 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.100100 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.100185 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.100268 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.100356 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.100460 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.100551 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.100637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.100720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.100802 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.100900 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.101012 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.101105 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.101190 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.101279 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.101279 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.101460 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.101546 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.101636 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.101721 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.101804 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.101901 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.101985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.102067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.102149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.102295 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.102387 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.102481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.102566 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.102648 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.102730 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.102813 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.102896 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.102996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.103081 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.103164 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.103254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.103339 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.103456 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.103545 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.103654 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.103747 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.103839 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.103963 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.104064 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.104157 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.104242 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.104342 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.104749 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.104861 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.104963 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.105049 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.105152 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.105236 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.105320 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.105403 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.105519 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.105618 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.105711 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.105796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.105879 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.105972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.106058 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.106147 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.106232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.106315 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.106405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.106503 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.106595 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.106679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.106768 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.106854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.106937 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.107028 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.107113 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.107196 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.107286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.107378 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.107469 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.107562 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.107673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.107760 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.107854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.107854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.108023 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.108110 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.108200 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.108292 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.108377 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.108478 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.108580 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.108674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.108765 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.108851 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.108947 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.109033 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.109124 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.109209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.109292 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.109388 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.109482 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.109568 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.109651 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.109742 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.109834 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.109928 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.110014 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.110104 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.110189 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.110279 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.110365 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.110462 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.110554 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.110638 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.110721 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.110819 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.110904 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.111001 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.111086 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.111177 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.111261 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.111344 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.111436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.111527 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.111619 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.111702 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.111792 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.111877 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.111969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.111969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.112347 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.112479 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.112567 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.112651 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.112744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.112829 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.112911 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.112997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.113080 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.113163 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.113255 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.113340 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.113430 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.113527 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.113613 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.113695 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.113792 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.113884 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.113978 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.114063 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.114148 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.114305 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.114392 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.114392 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.114550 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.114550 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.114921 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.115018 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.115128 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.115221 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.115305 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.115388 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.115471 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.115570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.115656 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.115795 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.115954 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.116148 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.116258 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.116514 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.116638 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.116729 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.116822 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.117037 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.117150 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.117343 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.117437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.117650 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.117750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.117958 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.118062 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.118262 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.118362 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.118561 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.118652 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.118861 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.118962 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.119201 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.119303 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.119514 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.119628 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.119820 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.119935 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.120137 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.120235 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.120459 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.120560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.120768 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.120894 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.121070 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.121206 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.121381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.121517 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.121685 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.121895 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.122001 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.122205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.122557 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.123092 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.123403 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.123711 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.124027 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.124340 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.124673 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.124957 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.125060 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.125301 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.125382 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.125632 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.125736 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.126036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.126348 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.126660 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.126964 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.127144 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.127279 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.127497 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.127614 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.127834 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.127935 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.128161 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.128269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.128511 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.128609 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.128843 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.128943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.129185 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.129300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.129514 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.129623 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.129821 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.129959 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.130121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.130393 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.130495 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.130717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.130821 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.131020 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.131120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.131323 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.131415 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.131646 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.131739 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.131957 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.132059 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.132263 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.132357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.132699 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.132774 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.132891 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.132991 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.133243 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.133334 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.133549 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.133649 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.133868 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.133964 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.134193 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.134330 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.134508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.134599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.135362 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.135462 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.135677 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.135776 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.135972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.136070 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.136288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.136426 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.136620 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.136906 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.136997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.137228 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.137333 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.137545 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.137648 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.137847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.137948 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.138150 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.138253 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.138464 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.138555 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.138775 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.138883 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.139086 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.139193 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.139400 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.139500 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.139715 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.139814 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.140023 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.140128 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.140329 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.140442 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.140675 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.140765 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.140985 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.141261 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.141355 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.141589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.141680 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.141900 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.142001 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.142213 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.142305 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.142526 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.142634 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.142842 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.142957 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.143153 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.143246 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.143465 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.143568 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.143770 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.143863 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.144082 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.144183 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.144428 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.144526 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.144722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.144816 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.145042 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.145145 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.145349 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.145461 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.145651 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.145753 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.145958 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.146056 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.146272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.146374 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.146566 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.146657 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.146872 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.146964 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.147175 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.147319 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.147479 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.147632 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.147784 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.147947 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.148099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.148253 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.148546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.148718 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.148818 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.148913 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.149092 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.149193 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.149421 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.149528 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.149732 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.149826 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.150039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.150211 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.150902 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.151119 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.151226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.151439 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.151540 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.151755 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.151847 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.152062 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.152173 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.152367 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.152532 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.152703 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.152882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.153032 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.153192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.153340 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.153500 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.153646 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.153829 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.153933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.154135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.154263 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.154440 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.154570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.154745 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.154895 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.155056 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.155315 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.155424 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.155633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.155843 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.155934 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.156009 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.156251 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.156357 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.156590 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.156717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.156898 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.156991 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.157202 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.157294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.157512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.157613 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.157816 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.157917 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.158134 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.158227 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.158445 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.158549 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.158748 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.158848 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.159051 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.159151 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.159362 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.159482 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.159670 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.159762 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.159972 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.160075 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.160286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.160409 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.160635 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.160745 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.160960 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.161052 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.161267 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.161361 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.161572 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.161672 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.161877 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.161993 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.162188 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.162324 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.162503 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.162624 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.162809 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.162975 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.163137 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.163270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.163447 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.163578 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.163752 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.163884 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.164053 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.164199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.164363 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.164532 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.164770 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.164875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.165080 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.165172 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.165392 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.165485 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.165718 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.165833 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.166057 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.166149 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.166361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.166461 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.166670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.166796 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.166974 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.167086 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.167282 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.167383 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.167585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.167679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.167894 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.167993 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.168196 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.168289 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.168522 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.168630 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.168827 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.168927 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.169132 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.169223 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.169435 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.169535 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.169758 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.169851 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.170062 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.170167 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.170365 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.170464 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.170798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.170904 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.170991 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.171088 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.171310 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.171413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.171618 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.171718 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.171950 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.172058 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.172277 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.172383 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.172611 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.172717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.172943 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.173063 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.173258 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.173370 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.173571 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.173679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.173879 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.173973 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.174182 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.174274 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.174498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.174598 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.174801 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.174893 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.175106 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.175206 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.175406 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.175511 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.175707 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.175821 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.176014 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.176107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.176317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.176430 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.176652 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.176763 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.176956 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.177061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.177262 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.177357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.177566 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.177659 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.177891 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.177983 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.178197 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.178291 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.178521 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.178614 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.178831 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.178933 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.179137 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.179240 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.179447 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.179537 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.179749 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.179848 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.180062 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.180154 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.180376 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.180510 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.180713 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.180828 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.181024 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.181130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.181332 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.181434 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.181666 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.181784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.181979 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.182071 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.182286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.182378 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.182601 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.182705 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.182914 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.183027 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.183223 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.183337 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.183531 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.183621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.183836 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.183937 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.184149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.184249 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.184490 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.184590 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.184794 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.185032 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.185335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.185431 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.185653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.185746 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.185963 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.186067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.186273 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.186365 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.186585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.186686 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.186898 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.187005 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.187215 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.187332 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.187519 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.187622 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.187828 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.187928 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.188139 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.188237 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.188473 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.188572 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.188807 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.188899 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.189128 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.189240 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.189454 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.189545 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.189765 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.189857 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.190093 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.190187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.190398 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.190489 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.190705 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.190797 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.191013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.191114 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.191340 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.191439 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.191646 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.191746 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.191959 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.192064 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.192275 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.192378 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.192626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.192734 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.192943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.193035 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.193260 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.193390 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.193576 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.193689 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.193892 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.193986 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.194209 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.194309 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.194519 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.194622 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.194831 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.194932 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.195147 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.195250 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.195463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.195557 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.195788 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.195880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.196123 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.196239 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.196464 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.196575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.196780 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.196880 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.197096 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.197732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.197949 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.198052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.198272 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.198468 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.198599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.198781 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.198914 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.199117 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.199237 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.199448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.199654 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.199760 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.199980 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.200072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.200292 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.200450 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.200640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.200751 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.200972 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.201071 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.201279 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.201379 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.201590 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.201700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.201899 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.202005 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.202203 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.202295 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.202509 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.202609 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.202825 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.202925 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.203129 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.203222 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.203438 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.203545 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.203746 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.203839 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.204054 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.204281 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.204408 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.204662 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.204763 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.204982 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.205087 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.205285 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.205390 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.205610 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.205702 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.205923 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.206025 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.206232 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.206349 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.206558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.206651 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.206860 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.206960 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.207164 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.207265 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.207480 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.207573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.207782 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.207874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.208087 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.208190 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.208402 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.208494 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.208730 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.208829 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.209040 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.209135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.209344 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.209438 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.209655 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.209756 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.209958 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.210052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.210287 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.210377 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.210592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.210697 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.210898 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.210991 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.211202 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.211294 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.211515 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.211617 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.211821 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.211914 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.212378 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.212520 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.212710 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.212858 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.213663 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.213879 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.213979 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.214202 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.214294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.214510 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.214655 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.214820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.214962 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.215126 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.215293 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.215435 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.215613 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.215738 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.215926 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.216044 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.216252 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.216344 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.216586 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.216680 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.216894 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.216999 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.217199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.217302 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.217519 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.217633 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.217837 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.217930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.218165 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.218293 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.218480 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.218592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.218789 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.218895 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.219119 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.219211 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.219442 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.219534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.219750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.219978 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.220077 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.220317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.220432 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.220692 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.220787 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.221009 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.221101 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.221331 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.221425 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.221647 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.221740 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.221952 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.222045 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.222259 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.222360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.222566 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.222666 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.222883 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.222976 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.223195 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.223288 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.223507 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.223610 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.223819 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.224027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.224133 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.224354 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.224469 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.224694 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.224789 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.225006 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.225099 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.225320 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.225422 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.225636 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.225730 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.225946 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.226047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.226256 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.226395 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.226563 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.226667 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.226873 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.226965 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.227185 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.227322 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.227512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.227610 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.227832 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.227933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.228145 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.228257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.228552 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.228659 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.228874 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.228983 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.229183 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.229321 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.229495 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.229598 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.229805 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.229906 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.230113 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.230207 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.230427 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.230520 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.230753 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.230860 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.231064 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.231164 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.231370 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.231462 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.231683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.231792 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.231995 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.232088 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.232307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.232439 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.232648 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.232759 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.232961 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.233061 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.233271 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.233365 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.233579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.233674 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.233893 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.233995 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.234207 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.234301 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.234533 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.234637 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.234863 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.234962 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.235180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.235272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.235495 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.235597 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.235811 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.235914 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.236125 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.236228 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.236451 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.236665 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.236763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.236979 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.237081 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.237314 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.237452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.237667 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.237916 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.238010 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.238251 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.238355 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.238563 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.238689 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.238867 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.239010 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.239200 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.239486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.239581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.239798 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.239889 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.240108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.240209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.240436 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.240556 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.240743 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.240840 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.241051 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.241153 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.241360 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.241453 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.241663 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.241761 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.241969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.242080 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.242277 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.242378 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.242589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.242808 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.242910 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.243162 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.243263 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.243480 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.243583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.243784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.243885 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.244131 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.244228 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.244470 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.244568 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.244822 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.245000 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.245096 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.245191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.245400 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.245499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.245705 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.245864 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.246021 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.246116 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.246333 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.246426 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.246642 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.246767 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.246951 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.247058 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.247260 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.247362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.247570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.247671 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.247870 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.247960 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.248179 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.248280 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.248503 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.248634 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.248832 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.248942 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.249137 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.249249 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.249441 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.249535 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.249744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.249838 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.250058 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.250160 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.250363 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.250456 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.250666 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.250758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.250981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.251084 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.251288 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.251381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.251600 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.251694 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.251904 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.252006 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.252213 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.252306 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.252583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.252691 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.252898 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.253001 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.253212 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.253306 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.253525 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.253617 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.253833 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.253933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.254143 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.254239 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.254448 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.254539 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.254751 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.254853 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.255060 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.255159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.255367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.255466 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.255681 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.255775 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.255991 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.256127 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.256303 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.256450 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.256649 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.256801 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.256975 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.257077 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.257302 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.257506 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.257643 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.257846 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.257947 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.258171 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.258276 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.258510 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.258604 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.258849 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.258951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.259176 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.259306 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.259464 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.259566 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.260242 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 03:06:52.260338 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.260648 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.261052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.261378 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.261692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.262005 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.262319 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.262632 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.262945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.263257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.263567 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.263877 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.264187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.264520 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.264833 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.265143 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.265458 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.265798 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.266116 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.266433 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.266748 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.267064 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.267373 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.267681 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.267988 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.268294 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.268629 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.268961 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.269275 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.269580 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.270000 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.270313 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.270631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.270951 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.271265 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.271586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.271908 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.272220 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.272565 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.272877 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.273207 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.273546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.273876 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.274200 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.274505 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.274808 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.275112 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.275985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.276310 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.276645 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.276953 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.277257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.277568 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.277874 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.278182 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.278486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.278790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.279101 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.279402 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.279706 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.280009 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.280313 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.280640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.280952 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.281262 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.281565 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.281871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.282173 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.282477 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.282779 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.283109 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.283442 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.283756 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.284080 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.284406 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.284741 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.285052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.285373 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.285695 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.286011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.286319 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.286651 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.286962 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.287272 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.287583 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.287892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.288200 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.288534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.288862 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.289189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.289494 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.289824 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.290141 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.290463 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.290777 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.291108 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.291439 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.291751 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.292157 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.292495 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.292809 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.293121 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.293439 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.293751 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.294062 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.294379 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.294692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.295022 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.295347 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.295658 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.295985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.296311 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.296688 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.297002 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.297346 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.297674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.297990 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.298299 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.298604 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:52.298847 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 03:06:52.321420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO dbcounter [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] Registered counter for database nova_api Oct 14 03:06:52.342296 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_db.sqlalchemy.engines [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:52.349140 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writer thread running {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:52.362088 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO dbcounter [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] Registered counter for database nova_api Oct 14 03:06:52.382544 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_db.sqlalchemy.engines [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:52.389868 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writer thread running {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:52.406546 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.context [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e228678d-bf1f-4de4-9ba4-dd43fa30f246(cell1) {{(pid=119302) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 03:06:52.410670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:06:52.411176 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:06:52.412770 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:06:52.415258 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:06:52.415258 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:06:52.415962 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:06:52.417989 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO dbcounter [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] Registered counter for database nova_cell0 Oct 14 03:06:52.422101 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO dbcounter [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] Registered counter for database nova_cell1 Oct 14 03:06:52.429569 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_db.sqlalchemy.engines [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:52.431266 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_db.sqlalchemy.engines [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:52.437811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writer thread running {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:52.439941 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writer thread running {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:52.446261 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.context [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e228678d-bf1f-4de4-9ba4-dd43fa30f246(cell1) {{(pid=119301) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 03:06:52.450858 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:06:52.451322 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:06:52.452914 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:06:52.453654 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:06:52.454100 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:06:52.456119 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:06:52.458132 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO dbcounter [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] Registered counter for database nova_cell0 Oct 14 03:06:52.462412 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO dbcounter [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] Registered counter for database nova_cell1 Oct 14 03:06:52.469741 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_db.sqlalchemy.engines [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:52.471969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_db.sqlalchemy.engines [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:52.477945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writer thread running {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:52.479553 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writer thread running {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:52.588648 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO dbcounter [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] Registered counter for database nova_cell0 Oct 14 03:06:52.595679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_db.sqlalchemy.engines [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:52.603408 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writer thread running {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:52.629262 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO dbcounter [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] Registered counter for database nova_cell0 Oct 14 03:06:52.636774 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_db.sqlalchemy.engines [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:52.642764 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writer thread running {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:52.940236 dv-cinder-801522-13-smb devstack@n-api.service[119302]: WARNING keystonemiddleware.auth_token [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 03:06:52.947944 dv-cinder-801522-13-smb devstack@n-api.service[119302]: WARNING keystonemiddleware.auth_token [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 03:06:52.972349 dv-cinder-801522-13-smb devstack@n-api.service[119301]: WARNING keystonemiddleware.auth_token [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 03:06:52.980785 dv-cinder-801522-13-smb devstack@n-api.service[119301]: WARNING keystonemiddleware.auth_token [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 03:06:53.303838 dv-cinder-801522-13-smb devstack@n-api.service[119302]: WARNING keystonemiddleware.auth_token [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 03:06:53.310522 dv-cinder-801522-13-smb devstack@n-api.service[119302]: WARNING keystonemiddleware.auth_token [None req-2bc000f7-05f5-4e0b-a33f-083bf3ae799b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 03:06:53.315916 dv-cinder-801522-13-smb devstack@n-api.service[119302]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562cd8f659c0 pid: 119302 (default app) Oct 14 03:06:53.330651 dv-cinder-801522-13-smb devstack@n-api.service[119301]: WARNING keystonemiddleware.auth_token [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 03:06:53.336733 dv-cinder-801522-13-smb devstack@n-api.service[119301]: WARNING keystonemiddleware.auth_token [None req-0f74df65-e289-48c8-b5c0-177c45785ab3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 03:06:53.342294 dv-cinder-801522-13-smb devstack@n-api.service[119301]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562cd8f659c0 pid: 119301 (default app) Oct 14 03:07:30.045312 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=3 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:30.046988 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=3 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:30.047865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=3 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:30.048787 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=3 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:30.903814 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f0830eb7-200b-4d0b-a231-0d540cfdccce tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Action: 'create', calling method: .version_select at 0x7fdcc867f700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1464256369"}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:32.957235 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f0830eb7-200b-4d0b-a231-0d540cfdccce tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.924847 Oct 14 03:07:32.957875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1155 bytes} [Fri Oct 14 03:07:30 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2927 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 14 03:07:32.984158 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=3 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:32.984158 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=3 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:32.985417 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=3 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:32.986332 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=3 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:33.368251 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b2f1fa4c-ebaa-4490-b6e3-d543d70bc6fc tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Calling method '.version_select at 0x7fdcc86c20d0>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:33.857105 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b2f1fa4c-ebaa-4490-b6e3-d543d70bc6fc tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380" status: 200 len: 345 microversion: 2.1 time: 0.884718 Oct 14 03:07:33.863993 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 1/2] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Oct 14 03:07:32 2022] GET /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380 => generated 345 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:33.959409 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0993834c-2187-4ccd-99f9-f5266dd8165e tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] Calling method '.version_select at 0x7fdcc85533a0>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:34.078329 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-0993834c-2187-4ccd-99f9-f5266dd8165e tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f649948c-c8cd-4d9f-a272-ff0dba217844" status: 200 len: 351 microversion: 2.1 time: 0.123293 Oct 14 03:07:34.080266 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Oct 14 03:07:33 2022] GET /compute/v2.1/os-volumes/f649948c-c8cd-4d9f-a272-ff0dba217844 => generated 351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:34.880367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-55f75673-2ca0-44ab-970e-e100b22591f2 tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Calling method '.version_select at 0x7fdcc858b550>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:35.109055 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-55f75673-2ca0-44ab-970e-e100b22591f2 tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380" status: 200 len: 346 microversion: 2.1 time: 0.240434 Oct 14 03:07:35.120912 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Oct 14 03:07:34 2022] GET /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380 => generated 346 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:35.127147 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-06a5de47-e08c-4ee6-a114-506961a2c7a6 tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Action: 'create', calling method: .version_select at 0x7fdcc8553670>, body: {"snapshot": {"volume_id": "6ce9186f-8e47-4a55-afa7-dbfbcc753380", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1710847135"}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:35.811116 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-06a5de47-e08c-4ee6-a114-506961a2c7a6 tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.689622 Oct 14 03:07:35.812707 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 3/5] 10.222.0.13 () {60 vars in 1162 bytes} [Fri Oct 14 03:07:35 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:35.827491 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f400f816-3c3d-4068-bbaa-9e7073c95553 tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Calling method '.version_select at 0x7fdcc858ba60>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:36.002931 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f400f816-3c3d-4068-bbaa-9e7073c95553 tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/fe52872d-eb1e-4be2-bc2a-72d5f91afb7e" status: 200 len: 287 microversion: 2.1 time: 0.179180 Oct 14 03:07:36.003620 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 3/6] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Oct 14 03:07:35 2022] GET /compute/v2.1/os-snapshots/fe52872d-eb1e-4be2-bc2a-72d5f91afb7e => generated 287 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:36.017596 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-babeb717-963d-466e-b440-d44045f8ec06 tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Calling method '.version_select at 0x7fdcc84e55e0>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:36.107128 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-babeb717-963d-466e-b440-d44045f8ec06 tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.095493 Oct 14 03:07:36.114070 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1140 bytes} [Fri Oct 14 03:07:36 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:36.119850 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a9092e07-d561-4a5a-8e67-78656cbb20cb tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Calling method '.version_select at 0x7fdcc858bb80>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:36.192655 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a9092e07-d561-4a5a-8e67-78656cbb20cb tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/fe52872d-eb1e-4be2-bc2a-72d5f91afb7e" status: 200 len: 287 microversion: 2.1 time: 0.077091 Oct 14 03:07:36.197047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Oct 14 03:07:36 2022] GET /compute/v2.1/os-snapshots/fe52872d-eb1e-4be2-bc2a-72d5f91afb7e => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:37.207253 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d8969193-11e9-4ad0-a00f-d7dcf24a0f44 tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Calling method '.version_select at 0x7fdcc84e5a60>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:37.272222 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d8969193-11e9-4ad0-a00f-d7dcf24a0f44 tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/fe52872d-eb1e-4be2-bc2a-72d5f91afb7e" status: 200 len: 288 microversion: 2.1 time: 0.069568 Oct 14 03:07:37.273334 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 5/9] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Oct 14 03:07:37 2022] GET /compute/v2.1/os-snapshots/fe52872d-eb1e-4be2-bc2a-72d5f91afb7e => generated 288 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:37.285851 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-856bf77e-11a0-4be7-bb5e-59c09a78abdd tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Calling method '.version_select at 0x7fdcc858b5e0>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:37.409624 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-69d9fbe0-1e3a-4a55-b335-22c9bad8e504 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] Calling method '.version_select at 0x7fdcc84e5280>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:37.476153 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-69d9fbe0-1e3a-4a55-b335-22c9bad8e504 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ab807a7f-804b-41bd-8724-95f17208116e" status: 200 len: 351 microversion: 2.1 time: 0.070660 Oct 14 03:07:37.484992 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 6/10] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Oct 14 03:07:37 2022] GET /compute/v2.1/os-volumes/ab807a7f-804b-41bd-8724-95f17208116e => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:07:37.531534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-856bf77e-11a0-4be7-bb5e-59c09a78abdd tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/fe52872d-eb1e-4be2-bc2a-72d5f91afb7e" status: 202 len: 0 microversion: 2.1 time: 0.251004 Oct 14 03:07:37.532305 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 5/11] 10.222.0.13 () {58 vars in 1254 bytes} [Fri Oct 14 03:07:37 2022] DELETE /compute/v2.1/os-snapshots/fe52872d-eb1e-4be2-bc2a-72d5f91afb7e => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 03:07:37.540944 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0f7f8708-f4f0-443c-a80b-e70d1e1b387f tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Calling method '.version_select at 0x7fdcc8553a60>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:37.637094 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-0f7f8708-f4f0-443c-a80b-e70d1e1b387f tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/fe52872d-eb1e-4be2-bc2a-72d5f91afb7e" status: 200 len: 287 microversion: 2.1 time: 0.093165 Oct 14 03:07:37.637094 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 7/12] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Oct 14 03:07:37 2022] GET /compute/v2.1/os-snapshots/fe52872d-eb1e-4be2-bc2a-72d5f91afb7e => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:38.644896 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-da2b61ed-a22e-431d-973f-1fb3b050380f tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Calling method '.version_select at 0x7fdcc854e280>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:38.700838 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-da2b61ed-a22e-431d-973f-1fb3b050380f tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] HTTP exception thrown: Snapshot fe52872d-eb1e-4be2-bc2a-72d5f91afb7e could not be found. Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-da2b61ed-a22e-431d-973f-1fb3b050380f tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Request method failure captured: Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/os-snapshots/fe52872d-eb1e-4be2-bc2a-72d5f91afb7e HTTP/1.1 Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNJxDuGO_0e6GGUobSd9u2qhd8_UlUk4-c5WzZAmW6fhL9EzTP1URXNmK1c1-lKZ-qNvtCA7RN8pCxsRFj0-GPtwDN1ocjNZ-sWkv7Clxtuo_jL_x7oFsCxaL20WyvsgXEJ745Tzl-CHoLeww5K6CacyXskSYMXnK9fV3Dg7KYWr2bY Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 7023e0d1a56346108b270216bb5dc577 Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-375658650 Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:07:38.706004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:07:38.707560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7023e0d1a56346108b270216bb5dc577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7023e0d1a56346108b270216bb5dc577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7023e0d1a56346108b270216bb5dc577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7023e0d1a56346108b270216bb5dc577"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:07:38.707560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-VolumesSnapshotsTestJSON-375658650 Oct 14 03:07:38.707560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 7023e0d1a56346108b270216bb5dc577 Oct 14 03:07:38.707560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-375658650 Oct 14 03:07:38.707560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-VolumesSnapshotsTestJSON-375658650-project Oct 14 03:07:38.707560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:07:38.707560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:07:38.707560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: b2b2b170e1ca4bb58e6547e728a7075d Oct 14 03:07:38.707560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-VolumesSnapshotsTestJSON-375658650-project Oct 14 03:07:38.707560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: Oct 14 03:07:38.707560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Snapshot fe52872d-eb1e-4be2-bc2a-72d5f91afb7e could not be found. Oct 14 03:07:38.707560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': 'fe52872d-eb1e-4be2-bc2a-72d5f91afb7e'} Oct 14 03:07:38.707560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fe52872d-eb1e-4be2-bc2a-72d5f91afb7e could not be found. (HTTP 404) (Request-ID: req-8b721fc8-28ee-4f47-bc1c-2d3a2980c80b) Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:38.708640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:07:38.710790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fe52872d-eb1e-4be2-bc2a-72d5f91afb7e could not be found. Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 14 03:07:38.712579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:07:38.715350 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fe52872d-eb1e-4be2-bc2a-72d5f91afb7e could not be found. Oct 14 03:07:38.715350 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:38.715350 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:38.715350 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:38.715350 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:38.715350 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:38.715350 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:38.715350 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:07:38.715350 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:07:38.715350 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fe52872d-eb1e-4be2-bc2a-72d5f91afb7e could not be found. Oct 14 03:07:38.715350 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:38.717426 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-da2b61ed-a22e-431d-973f-1fb3b050380f tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Returning 404 to user: Snapshot fe52872d-eb1e-4be2-bc2a-72d5f91afb7e could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:07:38.717901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-da2b61ed-a22e-431d-973f-1fb3b050380f tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/fe52872d-eb1e-4be2-bc2a-72d5f91afb7e" status: 404 len: 111 microversion: 2.1 time: 0.078425 Oct 14 03:07:38.719731 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 6/13] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Oct 14 03:07:38 2022] GET /compute/v2.1/os-snapshots/fe52872d-eb1e-4be2-bc2a-72d5f91afb7e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:07:38.727841 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0e474285-2ee2-429f-bb9d-3c81d8a3ddf1 tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Calling method '.version_select at 0x7fdcc84e5310>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:39.087272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-0e474285-2ee2-429f-bb9d-3c81d8a3ddf1 tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380" status: 202 len: 0 microversion: 2.1 time: 0.360946 Oct 14 03:07:39.087272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 8/14] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Oct 14 03:07:38 2022] DELETE /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:07:39.093209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-203d1fd0-6c9a-4c62-a2db-a5063a240f64 tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Calling method '.version_select at 0x7fdcc854eca0>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:39.219469 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-203d1fd0-6c9a-4c62-a2db-a5063a240f64 tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380" status: 200 len: 345 microversion: 2.1 time: 0.129965 Oct 14 03:07:39.220033 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 7/15] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Oct 14 03:07:39 2022] GET /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380 => generated 345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:39.718565 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-85e278b1-0900-4167-96d2-3c433763f381 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] Calling method '.version_select at 0x7fdcc84e5d30>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:39.843348 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-85e278b1-0900-4167-96d2-3c433763f381 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/beaaf020-8312-4b45-8d34-b78c1b6b120a" status: 200 len: 350 microversion: 2.1 time: 0.130666 Oct 14 03:07:39.844294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 9/16] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Oct 14 03:07:39 2022] GET /compute/v2.1/os-volumes/beaaf020-8312-4b45-8d34-b78c1b6b120a => generated 350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:39.859328 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-15d8bdd2-6f4d-4f35-8bde-a33b15c674c3 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] Calling method '.version_select at 0x7fdcc84ae310>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:40.114468 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-15d8bdd2-6f4d-4f35-8bde-a33b15c674c3 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.259939 Oct 14 03:07:40.115039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 8/17] 10.222.0.13 () {58 vars in 1134 bytes} [Fri Oct 14 03:07:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:40.137910 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-4c5eaab0-3d04-4af6-9935-0168afecaf30 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] Calling method '.version_select at 0x7fdcc8553790>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:40.235081 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-32a4a3ae-31c5-487d-bb08-d22543825bfb tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Calling method '.version_select at 0x7fdcc84ae550>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:40.350986 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-4c5eaab0-3d04-4af6-9935-0168afecaf30 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.217420 Oct 14 03:07:40.351836 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 10/18] 10.222.0.13 () {58 vars in 1149 bytes} [Fri Oct 14 03:07:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:40.383845 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-231e12c4-ea0b-4246-b24b-e13abbc1efc3 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] Calling method '.version_select at 0x7fdcc8ea9940>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-32a4a3ae-31c5-487d-bb08-d22543825bfb tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] HTTP exception thrown: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-32a4a3ae-31c5-487d-bb08-d22543825bfb tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Request method failure captured: Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380 HTTP/1.1 Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNJxDuGO_0e6GGUobSd9u2qhd8_UlUk4-c5WzZAmW6fhL9EzTP1URXNmK1c1-lKZ-qNvtCA7RN8pCxsRFj0-GPtwDN1ocjNZ-sWkv7Clxtuo_jL_x7oFsCxaL20WyvsgXEJ745Tzl-CHoLeww5K6CacyXskSYMXnK9fV3Dg7KYWr2bY Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 7023e0d1a56346108b270216bb5dc577 Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-375658650 Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:07:40.420066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:07:40.421930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7023e0d1a56346108b270216bb5dc577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7023e0d1a56346108b270216bb5dc577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7023e0d1a56346108b270216bb5dc577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7023e0d1a56346108b270216bb5dc577"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:07:40.421930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-VolumesSnapshotsTestJSON-375658650 Oct 14 03:07:40.421930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 7023e0d1a56346108b270216bb5dc577 Oct 14 03:07:40.421930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-375658650 Oct 14 03:07:40.421930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-VolumesSnapshotsTestJSON-375658650-project Oct 14 03:07:40.421930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:07:40.421930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:07:40.421930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: b2b2b170e1ca4bb58e6547e728a7075d Oct 14 03:07:40.421930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-VolumesSnapshotsTestJSON-375658650-project Oct 14 03:07:40.421930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: Oct 14 03:07:40.421930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.421930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '6ce9186f-8e47-4a55-afa7-dbfbcc753380'} Oct 14 03:07:40.421930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. (HTTP 404) (Request-ID: req-5c1798d1-dcd6-4fb3-8943-eec97874d937) Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:40.422965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:07:40.424637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 03:07:40.428061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:07:40.429360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.429360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.429360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:40.429360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.429360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:40.429360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:40.429360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:40.429360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:07:40.429360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:07:40.429360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.429360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.429360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-32a4a3ae-31c5-487d-bb08-d22543825bfb tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Returning 404 to user: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:07:40.429360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-32a4a3ae-31c5-487d-bb08-d22543825bfb tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380" status: 404 len: 109 microversion: 2.1 time: 0.188795 Oct 14 03:07:40.429360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 9/19] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Oct 14 03:07:40 2022] GET /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380 => generated 109 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:07:40.446519 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-11e50341-f804-43d2-8316-f4200154a3fd tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Calling method '.version_select at 0x7fdcc854eee0>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:40.548496 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-231e12c4-ea0b-4246-b24b-e13abbc1efc3 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.169810 Oct 14 03:07:40.557621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 11/20] 10.222.0.13 () {58 vars in 1134 bytes} [Fri Oct 14 03:07:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:40.564568 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-aac242b3-defd-4513-a7e3-51733e4781b2 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] Calling method '.version_select at 0x7fdcc84e5790>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:40.596593 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-11e50341-f804-43d2-8316-f4200154a3fd tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] HTTP exception thrown: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-11e50341-f804-43d2-8316-f4200154a3fd tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Request method failure captured: Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: DELETE /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380 HTTP/1.1 Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNJxDuGO_0e6GGUobSd9u2qhd8_UlUk4-c5WzZAmW6fhL9EzTP1URXNmK1c1-lKZ-qNvtCA7RN8pCxsRFj0-GPtwDN1ocjNZ-sWkv7Clxtuo_jL_x7oFsCxaL20WyvsgXEJ745Tzl-CHoLeww5K6CacyXskSYMXnK9fV3Dg7KYWr2bY Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 7023e0d1a56346108b270216bb5dc577 Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-375658650 Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:07:40.598578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:07:40.599872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7023e0d1a56346108b270216bb5dc577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7023e0d1a56346108b270216bb5dc577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7023e0d1a56346108b270216bb5dc577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7023e0d1a56346108b270216bb5dc577"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:07:40.599872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-VolumesSnapshotsTestJSON-375658650 Oct 14 03:07:40.599872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 7023e0d1a56346108b270216bb5dc577 Oct 14 03:07:40.599872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-375658650 Oct 14 03:07:40.599872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-VolumesSnapshotsTestJSON-375658650-project Oct 14 03:07:40.599872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:07:40.599872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:07:40.599872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: b2b2b170e1ca4bb58e6547e728a7075d Oct 14 03:07:40.599872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-VolumesSnapshotsTestJSON-375658650-project Oct 14 03:07:40.599872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: Oct 14 03:07:40.599872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.599872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '6ce9186f-8e47-4a55-afa7-dbfbcc753380'} Oct 14 03:07:40.599872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. (HTTP 404) (Request-ID: req-71c18825-5661-4213-98ee-04d52a305ed6) Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:40.600686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 03:07:40.603475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 14 03:07:40.605205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:07:40.607575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.607575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.607575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:40.607575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.607575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:40.607575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:40.607575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:40.607575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:07:40.607575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:07:40.607575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.607575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.607575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-11e50341-f804-43d2-8316-f4200154a3fd tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Returning 404 to user: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:07:40.607575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-11e50341-f804-43d2-8316-f4200154a3fd tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380" status: 404 len: 109 microversion: 2.1 time: 0.157868 Oct 14 03:07:40.607575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 10/21] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Oct 14 03:07:40 2022] DELETE /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380 => generated 109 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:07:40.609641 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-cd00a972-1fa1-4af4-b63c-989326a9493f tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Calling method '.version_select at 0x7fdcc854e9d0>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:40.709990 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-aac242b3-defd-4513-a7e3-51733e4781b2 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.148890 Oct 14 03:07:40.710568 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 12/22] 10.222.0.13 () {58 vars in 1167 bytes} [Fri Oct 14 03:07:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:07:40.729368 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2982a87f-483d-4663-a07a-965166925742 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] Calling method '.version_select at 0x7fdcc84e9a60>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:40.755207 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-cd00a972-1fa1-4af4-b63c-989326a9493f tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] HTTP exception thrown: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-cd00a972-1fa1-4af4-b63c-989326a9493f tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Request method failure captured: Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380 HTTP/1.1 Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNJxDuGO_0e6GGUobSd9u2qhd8_UlUk4-c5WzZAmW6fhL9EzTP1URXNmK1c1-lKZ-qNvtCA7RN8pCxsRFj0-GPtwDN1ocjNZ-sWkv7Clxtuo_jL_x7oFsCxaL20WyvsgXEJ745Tzl-CHoLeww5K6CacyXskSYMXnK9fV3Dg7KYWr2bY Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 7023e0d1a56346108b270216bb5dc577 Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-375658650 Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:07:40.759159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:07:40.768061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7023e0d1a56346108b270216bb5dc577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7023e0d1a56346108b270216bb5dc577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7023e0d1a56346108b270216bb5dc577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7023e0d1a56346108b270216bb5dc577"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:07:40.768061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-VolumesSnapshotsTestJSON-375658650 Oct 14 03:07:40.768061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 7023e0d1a56346108b270216bb5dc577 Oct 14 03:07:40.768061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-375658650 Oct 14 03:07:40.768061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-VolumesSnapshotsTestJSON-375658650-project Oct 14 03:07:40.768061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:07:40.768061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:07:40.768061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: b2b2b170e1ca4bb58e6547e728a7075d Oct 14 03:07:40.768061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-VolumesSnapshotsTestJSON-375658650-project Oct 14 03:07:40.768061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: Oct 14 03:07:40.768061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.768061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '6ce9186f-8e47-4a55-afa7-dbfbcc753380'} Oct 14 03:07:40.768061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. (HTTP 404) (Request-ID: req-571f031d-9db7-494a-b5d3-9108fc64bad5) Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:40.769823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:07:40.771135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 03:07:40.773107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:07:40.776905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.776905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.776905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:40.776905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.776905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:40.776905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:40.776905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:40.776905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:07:40.776905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:07:40.776905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. Oct 14 03:07:40.776905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:07:40.776905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-cd00a972-1fa1-4af4-b63c-989326a9493f tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] Returning 404 to user: Volume 6ce9186f-8e47-4a55-afa7-dbfbcc753380 could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:07:40.776905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-cd00a972-1fa1-4af4-b63c-989326a9493f tempest-VolumesSnapshotsTestJSON-375658650 tempest-VolumesSnapshotsTestJSON-375658650-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380" status: 404 len: 109 microversion: 2.1 time: 0.156479 Oct 14 03:07:40.776905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 11/23] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Oct 14 03:07:40 2022] GET /compute/v2.1/os-volumes/6ce9186f-8e47-4a55-afa7-dbfbcc753380 => generated 109 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:07:41.003440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2982a87f-483d-4663-a07a-965166925742 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.272617 Oct 14 03:07:41.003440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 13/24] 10.222.0.13 () {58 vars in 1170 bytes} [Fri Oct 14 03:07:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:41.011052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-cc542745-9f8a-42a0-a857-f61544b25116 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] Calling method '.version_select at 0x7fdcc854e040>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:41.225807 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-cc542745-9f8a-42a0-a857-f61544b25116 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.219123 Oct 14 03:07:41.226387 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 12/25] 10.222.0.13 () {58 vars in 1155 bytes} [Fri Oct 14 03:07:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:41.242076 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a7181848-3d16-4b4f-954e-deca2b06bac7 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] Calling method '.version_select at 0x7fdcc84e51f0>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:41.454760 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-a7181848-3d16-4b4f-954e-deca2b06bac7 tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.216337 Oct 14 03:07:41.456931 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 14/26] 10.222.0.13 () {58 vars in 1188 bytes} [Fri Oct 14 03:07:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:41.471190 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3feaa4a4-0b50-4731-8166-262fd8b8b71c tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] Calling method '.version_select at 0x7fdcc84c65e0>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:41.609124 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3feaa4a4-0b50-4731-8166-262fd8b8b71c tempest-VolumesTestJSON-1780845246 tempest-VolumesTestJSON-1780845246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.141951 Oct 14 03:07:41.609988 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 13/27] 10.222.0.13 () {58 vars in 1155 bytes} [Fri Oct 14 03:07:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:43.639846 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1601428762", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "networks": [{"uuid": "8b3a07a0-4b44-48cc-b162-8f137824746d"}]}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:43.872869 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.network.neutron [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] validate_networks() for [('8b3a07a0-4b44-48cc-b162-8f137824746d', None, None, None, None, None)] {{(pid=119302) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:07:44.768661 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d95c4e19-ced7-452d-a330-47899b4a3a25 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Action: 'create', calling method: .version_select at 0x7fdcc84ae3a0>, body: {"keypair": {"name": "tempest-keypair-192715436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGzZoDKlfqknN2nXrHjBNUXe9DY45NIrwvk5rfDpMeJOdTg2PC8DPD8bf20aGIuReTfgOb+bNLE6nX39nSrfr7fRQP5ehCh3UX6PWusq7VmtDJkbdLNdTNDdAlCqNa/Rw=="}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:44.899849 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-d95c4e19-ced7-452d-a330-47899b4a3a25 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Getting quotas for project ab840c288db6497bbd3a4b221cddf009. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:44.918482 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-d95c4e19-ced7-452d-a330-47899b4a3a25 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Getting quotas for user 2c196d842c4540b5800b4efa0ec4fc73 and project ab840c288db6497bbd3a4b221cddf009. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:45.121690 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d95c4e19-ced7-452d-a330-47899b4a3a25 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.844081 Oct 14 03:07:45.122780 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 14/28] 10.222.0.13 () {60 vars in 1159 bytes} [Fri Oct 14 03:07:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:07:45.744884 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Flavor limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:07:45.746202 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Image limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:07:45.746905 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Flavor pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:07:45.747461 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Image pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:07:45.748033 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:07:45.781754 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:45.784300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:45.785712 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:45.789874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:45.790646 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:45.791251 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:45.844705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Getting quotas for project 8b6e8512548449958d68927e75882932. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:45.853128 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Getting quotas for user ffc19ded49a74261b48bbe7c2a7f1904 and project 8b6e8512548449958d68927e75882932. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:45.866684 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Going to run 1 instances... {{(pid=119302) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:07:45.870105 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:07:46.079876 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d01ee1ea-4dd7-4543-ba27-f4c3e9146c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.821820 Oct 14 03:07:46.089590 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 15/29] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:07:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:07:46.094327 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b56b3a05-3a1f-4a5e-a6d6-c62607e7d3c3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:46.095877 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b56b3a05-3a1f-4a5e-a6d6-c62607e7d3c3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:46.416727 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b56b3a05-3a1f-4a5e-a6d6-c62607e7d3c3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:46.445967 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b56b3a05-3a1f-4a5e-a6d6-c62607e7d3c3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1215 microversion: 2.1 time: 0.355495 Oct 14 03:07:46.446559 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 15/30] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:46 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1215 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:47.472328 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ba90a1b2-cf29-431e-8d1f-6bce29f37c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:47.474131 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ba90a1b2-cf29-431e-8d1f-6bce29f37c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:47.638071 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ba90a1b2-cf29-431e-8d1f-6bce29f37c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:47.677734 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ba90a1b2-cf29-431e-8d1f-6bce29f37c50 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1215 microversion: 2.1 time: 0.209762 Oct 14 03:07:47.694247 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 16/31] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:47 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1215 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:48.704248 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f9c1fb99-104b-43ed-b2c9-9dbb6f7f3bf7 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:48.706465 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f9c1fb99-104b-43ed-b2c9-9dbb6f7f3bf7 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:48.908762 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f9c1fb99-104b-43ed-b2c9-9dbb6f7f3bf7 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:48.922000 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f9c1fb99-104b-43ed-b2c9-9dbb6f7f3bf7 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1215 microversion: 2.1 time: 0.222624 Oct 14 03:07:48.938459 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 16/32] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:48 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:49.950129 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0e8d7d31-2c1b-4ad8-915b-855f705a7b0b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:49.950840 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-0e8d7d31-2c1b-4ad8-915b-855f705a7b0b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:49.959354 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0e8d7d31-2c1b-4ad8-915b-855f705a7b0b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:49.961473 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0e8d7d31-2c1b-4ad8-915b-855f705a7b0b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:49.963072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0e8d7d31-2c1b-4ad8-915b-855f705a7b0b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:49.964677 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0e8d7d31-2c1b-4ad8-915b-855f705a7b0b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:49.965505 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0e8d7d31-2c1b-4ad8-915b-855f705a7b0b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:49.966770 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0e8d7d31-2c1b-4ad8-915b-855f705a7b0b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:50.263532 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-0e8d7d31-2c1b-4ad8-915b-855f705a7b0b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:50.281896 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-0e8d7d31-2c1b-4ad8-915b-855f705a7b0b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1211 microversion: 2.1 time: 0.337555 Oct 14 03:07:50.288521 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 17/33] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:49 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1211 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:50.970647 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-64fc5448-edbc-49a5-8806-f92c926ead78 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Action: 'create', calling method: .version_select at 0x7fdcc8414310>, body: {"keypair": {"name": "tempest-keypair-1730797856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLwUkDXNE6cbHnBa3ZVHc2qcHvPhNT5ig4sKppZs8MUEsBkPFYJdwaepTPRw+Dw9eGFE99cs3I1C0jirptdmZxc3S3fENoQQLAnj90VQEZUjhc4QbPHn1dpV5cogimICg=="}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:51.038718 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-64fc5448-edbc-49a5-8806-f92c926ead78 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:51.043982 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-64fc5448-edbc-49a5-8806-f92c926ead78 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for user 4553b7573ca34af6a9fdb94f80717f24 and project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:51.219813 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-64fc5448-edbc-49a5-8806-f92c926ead78 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.988125 Oct 14 03:07:51.220996 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 17/34] 10.222.0.13 () {60 vars in 1159 bytes} [Fri Oct 14 03:07:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:07:51.227566 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-345353867", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a9392e4-7197-4d73-834c-66b02f0faa24"}], "security_groups": [{"name": "tempest-securitygroup--1315951769"}], "key_name": "tempest-keypair-192715436", "user_data": "}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:51.511312 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-78fc73eb-dd8f-44f4-9f61-e3da397046bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Action: 'create', calling method: .version_select at 0x7fdcc7c06430>, body: {"keypair": {"name": "tempest-keypair-1273355437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJVP1wCvJ8ILSJsQbgDFJ8TO9fEnW6/wG2iWk3H7dloI2y5s5Rr0X4Uxr2X8Ubyc9J9JonDF8nsOP/kfByukTJhYsqPO378DTgDo1sTfHkc06wF0j6ZGP8oen8itvsQaA=="}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:51.599994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-78fc73eb-dd8f-44f4-9f61-e3da397046bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Getting quotas for project b28c1645ea1f4941ab2d016ad313ae6b. Resources: {'key_pairs'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:51.620239 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-78fc73eb-dd8f-44f4-9f61-e3da397046bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Getting quotas for user 1201fb5f14154b048f5c55bd566e91b9 and project b28c1645ea1f4941ab2d016ad313ae6b. Resources: {'key_pairs'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:51.801390 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.network.neutron [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] validate_networks() for [('4a9392e4-7197-4d73-834c-66b02f0faa24', None, None, None, None, None)] {{(pid=119301) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:07:51.807270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-78fc73eb-dd8f-44f4-9f61-e3da397046bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.372956 Oct 14 03:07:51.808245 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 18/35] 10.222.0.13 () {62 vars in 1200 bytes} [Fri Oct 14 03:07:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1374 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 14 03:07:51.813911 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-7f20d784-2a29-4ab3-8352-bb3b4708686b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:51.815314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-7f20d784-2a29-4ab3-8352-bb3b4708686b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:51.835740 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7f20d784-2a29-4ab3-8352-bb3b4708686b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:51.836115 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7f20d784-2a29-4ab3-8352-bb3b4708686b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:51.836590 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7f20d784-2a29-4ab3-8352-bb3b4708686b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:51.849159 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7f20d784-2a29-4ab3-8352-bb3b4708686b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:51.849840 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7f20d784-2a29-4ab3-8352-bb3b4708686b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:51.850306 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7f20d784-2a29-4ab3-8352-bb3b4708686b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:52.362555 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7f20d784-2a29-4ab3-8352-bb3b4708686b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:52.377244 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-7f20d784-2a29-4ab3-8352-bb3b4708686b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1285 microversion: 2.1 time: 0.567650 Oct 14 03:07:52.392633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 19/36] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:51 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1285 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:53.037152 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-655547369", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:53.169184 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.network.neutron [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] validate_networks() for [('1c246b20-9278-4e18-8b74-2f11a00777bc', None, None, None, None, None)] {{(pid=119302) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:07:55.429630 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Flavor limits 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:07:55.430183 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Image limits 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:07:55.430545 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Flavor pref 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:07:55.431292 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Image pref 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:07:55.431882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:07:55.456858 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:55.463819 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:55.466065 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:55.466907 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:55.467376 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:55.467816 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:55.701586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Getting quotas for project ab840c288db6497bbd3a4b221cddf009. Resources: {'instances', 'ram', 'cores'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:55.701586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Getting quotas for user 2c196d842c4540b5800b4efa0ec4fc73 and project ab840c288db6497bbd3a4b221cddf009. Resources: {'instances', 'ram', 'cores'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:55.759855 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Going to run 1 instances... {{(pid=119301) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:07:55.778275 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119301) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:07:55.827812 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=2 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:55.905184 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Flavor limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:07:55.906295 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Image limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:07:55.906295 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Flavor pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:07:55.906486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Image pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:07:55.906884 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:07:55.933954 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:55.935903 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:55.936468 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:55.940669 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:55.941189 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:55.941843 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:55.974335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Getting quotas for project 61f89b8e68d14d3d96fa84ab1697fcea. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:56.011620 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Getting quotas for user dbf0723a0f3942d2b9b2554320878016 and project 61f89b8e68d14d3d96fa84ab1697fcea. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:56.066121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Going to run 1 instances... {{(pid=119302) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:07:56.075697 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-49d916a6-ae52-463b-96be-2866f4bf8345 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.849020 Oct 14 03:07:56.082113 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:07:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 4860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:07:56.085732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:07:56.117215 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3319e572-98f8-4427-8492-e484603713a5 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:56.121330 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3319e572-98f8-4427-8492-e484603713a5 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:56.134578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3319e572-98f8-4427-8492-e484603713a5 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:56.135506 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3319e572-98f8-4427-8492-e484603713a5 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:56.136497 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3319e572-98f8-4427-8492-e484603713a5 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:56.137453 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3319e572-98f8-4427-8492-e484603713a5 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:56.138181 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3319e572-98f8-4427-8492-e484603713a5 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:56.138849 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3319e572-98f8-4427-8492-e484603713a5 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:56.260272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-fd88da7e-a71d-4699-8c47-547d132d8645 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.874405 Oct 14 03:07:56.264050 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 20/38] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:07:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 3879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:07:56.269833 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ce3ca6a0-b927-4328-9cc1-a0ecf5bc166f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:56.287210 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ce3ca6a0-b927-4328-9cc1-a0ecf5bc166f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:56.558402 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ce3ca6a0-b927-4328-9cc1-a0ecf5bc166f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:56.567883 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ce3ca6a0-b927-4328-9cc1-a0ecf5bc166f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1236 microversion: 2.1 time: 0.301259 Oct 14 03:07:56.569672 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 21/39] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:56 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1236 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:56.596880 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b6c4a959-7c9b-4866-9325-d1b5e9cbed2f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:56.598469 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b6c4a959-7c9b-4866-9325-d1b5e9cbed2f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:57.169727 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b6c4a959-7c9b-4866-9325-d1b5e9cbed2f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:57.180615 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b6c4a959-7c9b-4866-9325-d1b5e9cbed2f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1221 microversion: 2.1 time: 0.604055 Oct 14 03:07:57.183752 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 22/40] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:56 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1221 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:57.322169 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3319e572-98f8-4427-8492-e484603713a5 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:57.355427 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3319e572-98f8-4427-8492-e484603713a5 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 1.267179 Oct 14 03:07:57.374671 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 19/41] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:56 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:57.519544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-672185427", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:57.596450 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c00a6eb5-28b3-4dba-b9df-50e94488aee7 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:57.598830 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c00a6eb5-28b3-4dba-b9df-50e94488aee7 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:57.673148 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.network.neutron [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] validate_networks() for [('1c246b20-9278-4e18-8b74-2f11a00777bc', None, None, None, None, None)] {{(pid=119302) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:07:57.971520 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c00a6eb5-28b3-4dba-b9df-50e94488aee7 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:57.971520 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c00a6eb5-28b3-4dba-b9df-50e94488aee7 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1236 microversion: 2.1 time: 0.377746 Oct 14 03:07:57.977257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 20/42] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:57 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1236 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:07:58.385673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d443770c-9582-4483-9d1f-46fcfa4f029e tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:58.386533 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d443770c-9582-4483-9d1f-46fcfa4f029e tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:58.402748 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d443770c-9582-4483-9d1f-46fcfa4f029e tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:58.403250 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d443770c-9582-4483-9d1f-46fcfa4f029e tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:58.410028 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d443770c-9582-4483-9d1f-46fcfa4f029e tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:58.412979 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d443770c-9582-4483-9d1f-46fcfa4f029e tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:58.413666 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d443770c-9582-4483-9d1f-46fcfa4f029e tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:58.417235 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d443770c-9582-4483-9d1f-46fcfa4f029e tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:59.207251 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d443770c-9582-4483-9d1f-46fcfa4f029e tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:59.235527 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d443770c-9582-4483-9d1f-46fcfa4f029e tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 0.855768 Oct 14 03:07:59.236407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 21/43] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:58 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:07:59.244134 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-81cd28bb-64a1-420d-a11c-da23c6ca46a9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:59.244787 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-81cd28bb-64a1-420d-a11c-da23c6ca46a9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:59.551940 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-81cd28bb-64a1-420d-a11c-da23c6ca46a9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:59.567323 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-81cd28bb-64a1-420d-a11c-da23c6ca46a9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1236 microversion: 2.1 time: 0.329264 Oct 14 03:07:59.567923 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 22/44] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:59 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1236 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:59.931250 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Flavor limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:07:59.931851 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Image limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:07:59.932511 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Flavor pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:07:59.933037 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Image pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:07:59.933810 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:07:59.975540 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:59.976083 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:59.987467 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:59.988092 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:59.994395 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:59.995294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:00.069656 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Getting quotas for project 61f89b8e68d14d3d96fa84ab1697fcea. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:08:00.099603 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Getting quotas for user dbf0723a0f3942d2b9b2554320878016 and project 61f89b8e68d14d3d96fa84ab1697fcea. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:08:00.140448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Going to run 1 instances... {{(pid=119302) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:08:00.143239 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:08:00.262783 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ec0ad9d6-fb7f-4fb8-aa8d-91ca8538c2d3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:00.263974 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ec0ad9d6-fb7f-4fb8-aa8d-91ca8538c2d3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:00.281020 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec0ad9d6-fb7f-4fb8-aa8d-91ca8538c2d3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:00.283521 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec0ad9d6-fb7f-4fb8-aa8d-91ca8538c2d3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:00.284698 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec0ad9d6-fb7f-4fb8-aa8d-91ca8538c2d3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:00.286585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec0ad9d6-fb7f-4fb8-aa8d-91ca8538c2d3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:00.290098 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec0ad9d6-fb7f-4fb8-aa8d-91ca8538c2d3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:00.290563 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec0ad9d6-fb7f-4fb8-aa8d-91ca8538c2d3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:00.634342 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ccbd9402-4fcf-4a03-8516-4cb3daaac9d5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.103518 Oct 14 03:08:00.634342 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:07:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 3105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 14 03:08:00.634342 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1380463303", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13e2568f-f327-4e0c-a407-87e103f9e880"}], "security_groups": [{"name": "tempest-securitygroup--318189047"}], "key_name": "tempest-keypair-1273355437", "user_data": "}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:01.291823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ec0ad9d6-fb7f-4fb8-aa8d-91ca8538c2d3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:01.314692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ec0ad9d6-fb7f-4fb8-aa8d-91ca8538c2d3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 1.056389 Oct 14 03:08:01.328414 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 23/46] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:00 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:01.335625 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-4948038e-0c5b-4403-92ae-77dac4b9d196 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:01.336582 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-4948038e-0c5b-4403-92ae-77dac4b9d196 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:01.353874 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4948038e-0c5b-4403-92ae-77dac4b9d196 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:01.361539 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4948038e-0c5b-4403-92ae-77dac4b9d196 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:01.367017 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4948038e-0c5b-4403-92ae-77dac4b9d196 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:01.367017 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4948038e-0c5b-4403-92ae-77dac4b9d196 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:01.367017 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4948038e-0c5b-4403-92ae-77dac4b9d196 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:01.367017 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4948038e-0c5b-4403-92ae-77dac4b9d196 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:01.419705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.network.neutron [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] validate_networks() for [('13e2568f-f327-4e0c-a407-87e103f9e880', None, None, None, None, None)] {{(pid=119302) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:08:01.577522 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4948038e-0c5b-4403-92ae-77dac4b9d196 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:01.590146 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-4948038e-0c5b-4403-92ae-77dac4b9d196 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1232 microversion: 2.1 time: 0.269237 Oct 14 03:08:01.591274 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 24/47] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:01 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1232 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:01.605783 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d84892e5-d181-4024-88d0-b347998919e9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:01.611061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d84892e5-d181-4024-88d0-b347998919e9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:02.000973 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d84892e5-d181-4024-88d0-b347998919e9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:02.009403 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d84892e5-d181-4024-88d0-b347998919e9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1221 microversion: 2.1 time: 0.415514 Oct 14 03:08:02.025649 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 25/48] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:01 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1221 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:02.033243 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1246460233", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fcf48d6-7187-4929-b5fb-8bc693b44fb9"}], "security_groups": [{"name": "tempest-securitygroup--1183164044"}], "key_name": "tempest-keypair-1730797856", "user_data": "}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:02.467077 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.network.neutron [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] validate_networks() for [('9fcf48d6-7187-4929-b5fb-8bc693b44fb9', None, None, None, None, None)] {{(pid=119301) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:08:03.059183 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Flavor limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:08:03.060267 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Image limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:08:03.060942 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Flavor pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:08:03.061521 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Image pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:08:03.062168 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:08:03.083783 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:03.084627 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:03.085238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:03.086220 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:03.086833 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:03.087475 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:03.108286 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Getting quotas for project b28c1645ea1f4941ab2d016ad313ae6b. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:08:03.112717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Getting quotas for user 1201fb5f14154b048f5c55bd566e91b9 and project b28c1645ea1f4941ab2d016ad313ae6b. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:08:03.128750 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Going to run 1 instances... {{(pid=119302) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:08:03.132144 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:08:03.497355 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ffb342ff-99f6-4a50-89c6-f44bf05fab1e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.876679 Oct 14 03:08:03.507160 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 24/49] 10.222.0.13 () {62 vars in 1188 bytes} [Fri Oct 14 03:08:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 2887 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 14 03:08:03.984529 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-e935e4b8-8807-45ac-bf38-f1800c6b9ce7 req-34eabc28-55c1-4ff5-a62b-e359fa1b589a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07aa0f1c-fa6a-478f-8b84-cf8124621ab3", "tag": "716fa502-e091-4124-9f6f-e98fb49bb739"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:04.135927 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-e935e4b8-8807-45ac-bf38-f1800c6b9ce7 req-34eabc28-55c1-4ff5-a62b-e359fa1b589a service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.137925 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-e935e4b8-8807-45ac-bf38-f1800c6b9ce7 req-34eabc28-55c1-4ff5-a62b-e359fa1b589a service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.138385 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-e935e4b8-8807-45ac-bf38-f1800c6b9ce7 req-34eabc28-55c1-4ff5-a62b-e359fa1b589a service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.229886 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Flavor limits 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:08:04.231808 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Image limits 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:08:04.232509 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Flavor pref 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:08:04.233242 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Image pref 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:08:04.234197 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:08:04.252159 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-e935e4b8-8807-45ac-bf38-f1800c6b9ce7 req-34eabc28-55c1-4ff5-a62b-e359fa1b589a service nova] Creating event network-changed:716fa502-e091-4124-9f6f-e98fb49bb739 for instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 on hv-cinder-80152 Oct 14 03:08:04.254726 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-e935e4b8-8807-45ac-bf38-f1800c6b9ce7 req-34eabc28-55c1-4ff5-a62b-e359fa1b589a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 14 03:08:04.257457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-e935e4b8-8807-45ac-bf38-f1800c6b9ce7 req-34eabc28-55c1-4ff5-a62b-e359fa1b589a service nova] Acquired lock "compute-rpcapi-router" {{(pid=119302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 14 03:08:04.261777 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.262598 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f9d07c1a-7ae9-426a-81e4-f2a343d87d2c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.263114 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f9d07c1a-7ae9-426a-81e4-f2a343d87d2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.263407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.263565 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f9d07c1a-7ae9-426a-81e4-f2a343d87d2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.263893 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.264368 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f9d07c1a-7ae9-426a-81e4-f2a343d87d2c None None] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.264745 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.264857 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f9d07c1a-7ae9-426a-81e4-f2a343d87d2c None None] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.265218 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.265376 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f9d07c1a-7ae9-426a-81e4-f2a343d87d2c None None] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.265721 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.323309 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.compute.rpcapi [None req-f9d07c1a-7ae9-426a-81e4-f2a343d87d2c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 14 03:08:04.324781 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f9d07c1a-7ae9-426a-81e4-f2a343d87d2c None None] Releasing lock "compute-rpcapi-router" {{(pid=119302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 14 03:08:04.338299 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'instances', 'ram', 'cores'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:08:04.349629 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for user 4553b7573ca34af6a9fdb94f80717f24 and project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'instances', 'ram', 'cores'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:08:04.512172 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f9d07c1a-7ae9-426a-81e4-f2a343d87d2c None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.862071 Oct 14 03:08:04.512172 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 25/50] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:04.512172 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-193f1433-141e-4238-a365-9f968c358c85 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:04.512925 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Going to run 1 instances... {{(pid=119301) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:08:04.513018 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-193f1433-141e-4238-a365-9f968c358c85 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:04.513112 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119301) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:08:04.513213 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-193f1433-141e-4238-a365-9f968c358c85 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.513213 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-193f1433-141e-4238-a365-9f968c358c85 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.513213 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-193f1433-141e-4238-a365-9f968c358c85 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.513213 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-193f1433-141e-4238-a365-9f968c358c85 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.513503 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-193f1433-141e-4238-a365-9f968c358c85 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.513503 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-193f1433-141e-4238-a365-9f968c358c85 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.752670 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0ba1d88a-3393-4928-a20e-eb8fcef5885c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.724188 Oct 14 03:08:04.754838 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 26/51] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:08:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 2728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:08:04.771139 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-2ee0f7ee-d4d2-48ce-9694-6f5d49d583de tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:04.773502 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-2ee0f7ee-d4d2-48ce-9694-6f5d49d583de tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:04.795851 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2ee0f7ee-d4d2-48ce-9694-6f5d49d583de tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.796382 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2ee0f7ee-d4d2-48ce-9694-6f5d49d583de tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.796862 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2ee0f7ee-d4d2-48ce-9694-6f5d49d583de tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.797607 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2ee0f7ee-d4d2-48ce-9694-6f5d49d583de tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.798100 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2ee0f7ee-d4d2-48ce-9694-6f5d49d583de tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.798494 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2ee0f7ee-d4d2-48ce-9694-6f5d49d583de tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:05.298670 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-2ee0f7ee-d4d2-48ce-9694-6f5d49d583de tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:05.349949 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-2ee0f7ee-d4d2-48ce-9694-6f5d49d583de tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1306 microversion: 2.1 time: 0.593644 Oct 14 03:08:05.353923 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 27/52] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:04 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1306 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:05.376098 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-161e30af-8818-4414-a2f9-409c4f054f9c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:05.377339 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-161e30af-8818-4414-a2f9-409c4f054f9c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:05.380188 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:05.386798 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-161e30af-8818-4414-a2f9-409c4f054f9c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:05.390542 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-161e30af-8818-4414-a2f9-409c4f054f9c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:05.390542 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-161e30af-8818-4414-a2f9-409c4f054f9c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:05.390542 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-161e30af-8818-4414-a2f9-409c4f054f9c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:05.390542 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-161e30af-8818-4414-a2f9-409c4f054f9c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:05.390942 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-161e30af-8818-4414-a2f9-409c4f054f9c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:05.616455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-161e30af-8818-4414-a2f9-409c4f054f9c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:05.654984 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-161e30af-8818-4414-a2f9-409c4f054f9c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1273 microversion: 2.1 time: 0.287575 Oct 14 03:08:05.654984 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 28/53] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:05 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1273 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:05.690775 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-06a19a6a-e895-4d8f-b8a2-63f42b152ab2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:05.694839 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-06a19a6a-e895-4d8f-b8a2-63f42b152ab2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:05.915711 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-193f1433-141e-4238-a365-9f968c358c85 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:05.928736 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-193f1433-141e-4238-a365-9f968c358c85 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 1.555039 Oct 14 03:08:05.943351 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 26/54] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:04 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:05.951511 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9dd05b0a-521c-4d9c-a101-0dc95185e9f4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:05.952347 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9dd05b0a-521c-4d9c-a101-0dc95185e9f4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:05.959051 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-06a19a6a-e895-4d8f-b8a2-63f42b152ab2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:05.966216 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=31 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:05.976031 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-06a19a6a-e895-4d8f-b8a2-63f42b152ab2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:05.978799 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-06a19a6a-e895-4d8f-b8a2-63f42b152ab2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:05.982566 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-06a19a6a-e895-4d8f-b8a2-63f42b152ab2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1282 microversion: 2.20 time: 0.331799 Oct 14 03:08:05.986371 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:05.988073 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 29/55] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:05 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1282 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:06.213529 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9dd05b0a-521c-4d9c-a101-0dc95185e9f4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:06.221848 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9dd05b0a-521c-4d9c-a101-0dc95185e9f4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1242 microversion: 2.1 time: 0.275976 Oct 14 03:08:06.256754 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 27/56] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:05 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1242 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:06.396358 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5fcc1249-5600-4428-bd5f-60d338500ce0 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:06.400049 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5fcc1249-5600-4428-bd5f-60d338500ce0 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:06.435687 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5fcc1249-5600-4428-bd5f-60d338500ce0 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:06.436577 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5fcc1249-5600-4428-bd5f-60d338500ce0 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:06.437195 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5fcc1249-5600-4428-bd5f-60d338500ce0 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:06.439374 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5fcc1249-5600-4428-bd5f-60d338500ce0 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:06.440217 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5fcc1249-5600-4428-bd5f-60d338500ce0 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:06.441354 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5fcc1249-5600-4428-bd5f-60d338500ce0 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:06.559561 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5fcc1249-5600-4428-bd5f-60d338500ce0 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:06.569149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5fcc1249-5600-4428-bd5f-60d338500ce0 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1294 microversion: 2.1 time: 0.193631 Oct 14 03:08:06.569744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 30/57] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:06 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1294 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:06.682935 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9427b6e6-6115-44bc-977a-062b00ea0131 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:06.683683 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9427b6e6-6115-44bc-977a-062b00ea0131 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:06.700203 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9427b6e6-6115-44bc-977a-062b00ea0131 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:06.700698 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9427b6e6-6115-44bc-977a-062b00ea0131 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:06.701258 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9427b6e6-6115-44bc-977a-062b00ea0131 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:06.704511 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9427b6e6-6115-44bc-977a-062b00ea0131 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:06.710679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9427b6e6-6115-44bc-977a-062b00ea0131 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:06.711238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9427b6e6-6115-44bc-977a-062b00ea0131 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:06.875622 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9427b6e6-6115-44bc-977a-062b00ea0131 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:06.898491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9427b6e6-6115-44bc-977a-062b00ea0131 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1279 microversion: 2.1 time: 0.223142 Oct 14 03:08:06.914354 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 28/58] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:06 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1279 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:06.951588 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-29c44ea5-fe53-45f7-8336-600d5c8b443a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:06.954186 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-29c44ea5-fe53-45f7-8336-600d5c8b443a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:06.984918 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-29c44ea5-fe53-45f7-8336-600d5c8b443a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:06.988578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-29c44ea5-fe53-45f7-8336-600d5c8b443a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:06.988578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-29c44ea5-fe53-45f7-8336-600d5c8b443a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:06.989196 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-29c44ea5-fe53-45f7-8336-600d5c8b443a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:06.990312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-29c44ea5-fe53-45f7-8336-600d5c8b443a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:06.991599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-29c44ea5-fe53-45f7-8336-600d5c8b443a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.019394 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-dd5d8994-9b77-4cd5-aa9a-2dee1c7984ac tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:07.020008 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-dd5d8994-9b77-4cd5-aa9a-2dee1c7984ac tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:07.031465 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd5d8994-9b77-4cd5-aa9a-2dee1c7984ac tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.033477 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd5d8994-9b77-4cd5-aa9a-2dee1c7984ac tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.037469 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd5d8994-9b77-4cd5-aa9a-2dee1c7984ac tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.039995 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd5d8994-9b77-4cd5-aa9a-2dee1c7984ac tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.042064 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd5d8994-9b77-4cd5-aa9a-2dee1c7984ac tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.043349 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd5d8994-9b77-4cd5-aa9a-2dee1c7984ac tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.267833 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-dd5d8994-9b77-4cd5-aa9a-2dee1c7984ac tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:07.280366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-dd5d8994-9b77-4cd5-aa9a-2dee1c7984ac tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:07.287537 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-dd5d8994-9b77-4cd5-aa9a-2dee1c7984ac tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:07.289883 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-dd5d8994-9b77-4cd5-aa9a-2dee1c7984ac tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1278 microversion: 2.20 time: 0.275631 Oct 14 03:08:07.294623 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 29/59] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:07 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1278 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:07.312423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d9eca9a6-0581-4a4e-91dc-d0efe1108957 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:07.313345 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d9eca9a6-0581-4a4e-91dc-d0efe1108957 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:07.323442 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d9eca9a6-0581-4a4e-91dc-d0efe1108957 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.324230 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d9eca9a6-0581-4a4e-91dc-d0efe1108957 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.324842 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d9eca9a6-0581-4a4e-91dc-d0efe1108957 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.325821 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d9eca9a6-0581-4a4e-91dc-d0efe1108957 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.326417 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d9eca9a6-0581-4a4e-91dc-d0efe1108957 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.326990 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d9eca9a6-0581-4a4e-91dc-d0efe1108957 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.376347 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-29c44ea5-fe53-45f7-8336-600d5c8b443a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:07.385410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-29c44ea5-fe53-45f7-8336-600d5c8b443a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 0.437985 Oct 14 03:08:07.401740 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 31/60] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:06 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:07.490009 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-d9eca9a6-0581-4a4e-91dc-d0efe1108957 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:07.503814 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d9eca9a6-0581-4a4e-91dc-d0efe1108957 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1246 microversion: 2.1 time: 0.205865 Oct 14 03:08:07.505469 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 30/61] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:07 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1246 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:07.593446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ca0be112-2a0f-4c12-92d8-a4b40b79e5c6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:07.594130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ca0be112-2a0f-4c12-92d8-a4b40b79e5c6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:07.610857 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ca0be112-2a0f-4c12-92d8-a4b40b79e5c6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.612440 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ca0be112-2a0f-4c12-92d8-a4b40b79e5c6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.614313 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ca0be112-2a0f-4c12-92d8-a4b40b79e5c6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.616312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ca0be112-2a0f-4c12-92d8-a4b40b79e5c6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.617838 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ca0be112-2a0f-4c12-92d8-a4b40b79e5c6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.619291 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ca0be112-2a0f-4c12-92d8-a4b40b79e5c6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.747872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ca0be112-2a0f-4c12-92d8-a4b40b79e5c6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:07.765603 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ca0be112-2a0f-4c12-92d8-a4b40b79e5c6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1294 microversion: 2.1 time: 0.177097 Oct 14 03:08:07.773024 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 32/62] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:07 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1294 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:07.942116 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e53e9d1c-1f09-47c2-a619-6897eebae49d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:07.942907 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e53e9d1c-1f09-47c2-a619-6897eebae49d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:07.957148 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e53e9d1c-1f09-47c2-a619-6897eebae49d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.957671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e53e9d1c-1f09-47c2-a619-6897eebae49d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.958112 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e53e9d1c-1f09-47c2-a619-6897eebae49d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.959109 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e53e9d1c-1f09-47c2-a619-6897eebae49d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.959618 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e53e9d1c-1f09-47c2-a619-6897eebae49d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.960376 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e53e9d1c-1f09-47c2-a619-6897eebae49d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.179086 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e53e9d1c-1f09-47c2-a619-6897eebae49d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:08.182484 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e53e9d1c-1f09-47c2-a619-6897eebae49d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1279 microversion: 2.1 time: 0.241109 Oct 14 03:08:08.183691 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 31/63] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:07 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1279 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:08.327909 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d45a9e99-04ad-4d8f-943c-48cbad7505e2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:08.329523 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d45a9e99-04ad-4d8f-943c-48cbad7505e2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:08.351850 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d45a9e99-04ad-4d8f-943c-48cbad7505e2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:08.353844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d45a9e99-04ad-4d8f-943c-48cbad7505e2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:08.355059 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d45a9e99-04ad-4d8f-943c-48cbad7505e2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.355967 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d45a9e99-04ad-4d8f-943c-48cbad7505e2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:08.364115 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d45a9e99-04ad-4d8f-943c-48cbad7505e2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:08.366661 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d45a9e99-04ad-4d8f-943c-48cbad7505e2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.410426 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3f4eb492-a5c8-45b6-8139-1f2465cc207a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:08.411742 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-3f4eb492-a5c8-45b6-8139-1f2465cc207a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:08.433399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3f4eb492-a5c8-45b6-8139-1f2465cc207a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:08.433919 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3f4eb492-a5c8-45b6-8139-1f2465cc207a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:08.434373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3f4eb492-a5c8-45b6-8139-1f2465cc207a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.449854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3f4eb492-a5c8-45b6-8139-1f2465cc207a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:08.449854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3f4eb492-a5c8-45b6-8139-1f2465cc207a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:08.449854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3f4eb492-a5c8-45b6-8139-1f2465cc207a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.524131 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d45a9e99-04ad-4d8f-943c-48cbad7505e2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:08.534116 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d45a9e99-04ad-4d8f-943c-48cbad7505e2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:08.536254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d45a9e99-04ad-4d8f-943c-48cbad7505e2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:08.537629 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d45a9e99-04ad-4d8f-943c-48cbad7505e2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1334 microversion: 2.20 time: 0.214760 Oct 14 03:08:08.538682 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:08 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1334 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:08.550453 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3db83dcf-8f09-43c3-8745-ff287b29adb9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:08.551421 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3db83dcf-8f09-43c3-8745-ff287b29adb9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:08.568992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3db83dcf-8f09-43c3-8745-ff287b29adb9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:08.569478 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3db83dcf-8f09-43c3-8745-ff287b29adb9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:08.573112 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3db83dcf-8f09-43c3-8745-ff287b29adb9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.578449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3db83dcf-8f09-43c3-8745-ff287b29adb9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:08.578449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3db83dcf-8f09-43c3-8745-ff287b29adb9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:08.578449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3db83dcf-8f09-43c3-8745-ff287b29adb9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.998798 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3db83dcf-8f09-43c3-8745-ff287b29adb9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:09.017060 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3db83dcf-8f09-43c3-8745-ff287b29adb9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1238 microversion: 2.1 time: 0.475335 Oct 14 03:08:09.019212 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 34/65] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:08 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1238 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:09.034742 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8985e6a4-df90-443d-b5c6-f936ecc423f2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:09.034742 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8985e6a4-df90-443d-b5c6-f936ecc423f2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:09.062204 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8985e6a4-df90-443d-b5c6-f936ecc423f2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:09.065192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8985e6a4-df90-443d-b5c6-f936ecc423f2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:09.065746 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8985e6a4-df90-443d-b5c6-f936ecc423f2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.068351 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8985e6a4-df90-443d-b5c6-f936ecc423f2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:09.069628 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8985e6a4-df90-443d-b5c6-f936ecc423f2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:09.071634 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8985e6a4-df90-443d-b5c6-f936ecc423f2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.554480 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8985e6a4-df90-443d-b5c6-f936ecc423f2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:09.568453 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8985e6a4-df90-443d-b5c6-f936ecc423f2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1362 microversion: 2.1 time: 0.547796 Oct 14 03:08:09.569544 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 35/66] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:09 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1362 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:09.585593 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a16d37a1-23ff-49fa-9316-dd7787e1c2d8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:09.587318 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a16d37a1-23ff-49fa-9316-dd7787e1c2d8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:09.591767 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3f4eb492-a5c8-45b6-8139-1f2465cc207a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:09.601166 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-3f4eb492-a5c8-45b6-8139-1f2465cc207a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 1.196047 Oct 14 03:08:09.608975 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 32/67] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:08 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:09.616991 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-afe86060-77aa-430f-922e-3d0d9bb61e55 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:09.786690 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a16d37a1-23ff-49fa-9316-dd7787e1c2d8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:09.786690 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a16d37a1-23ff-49fa-9316-dd7787e1c2d8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:09.786690 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a16d37a1-23ff-49fa-9316-dd7787e1c2d8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.786690 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a16d37a1-23ff-49fa-9316-dd7787e1c2d8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:09.787263 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a16d37a1-23ff-49fa-9316-dd7787e1c2d8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:09.787263 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a16d37a1-23ff-49fa-9316-dd7787e1c2d8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.787679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-afe86060-77aa-430f-922e-3d0d9bb61e55 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:09.787679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-afe86060-77aa-430f-922e-3d0d9bb61e55 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:09.787679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-afe86060-77aa-430f-922e-3d0d9bb61e55 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:09.787679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-afe86060-77aa-430f-922e-3d0d9bb61e55 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.788250 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-afe86060-77aa-430f-922e-3d0d9bb61e55 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:09.788250 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-afe86060-77aa-430f-922e-3d0d9bb61e55 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:09.788250 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-afe86060-77aa-430f-922e-3d0d9bb61e55 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.789361 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-afe86060-77aa-430f-922e-3d0d9bb61e55 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:09.789942 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a16d37a1-23ff-49fa-9316-dd7787e1c2d8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:09.790085 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-afe86060-77aa-430f-922e-3d0d9bb61e55 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:09.790085 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-afe86060-77aa-430f-922e-3d0d9bb61e55 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:09.796615 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-afe86060-77aa-430f-922e-3d0d9bb61e55 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1352 microversion: 2.20 time: 0.175006 Oct 14 03:08:09.798938 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 33/68] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:09 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1352 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:09.809496 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a16d37a1-23ff-49fa-9316-dd7787e1c2d8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1279 microversion: 2.1 time: 0.237006 Oct 14 03:08:09.822577 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 36/69] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:09 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1279 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:10.049384 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-57ec111d-fcf1-40f2-88f8-90a148077a78 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:10.050557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-57ec111d-fcf1-40f2-88f8-90a148077a78 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:10.078285 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-57ec111d-fcf1-40f2-88f8-90a148077a78 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.084455 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-57ec111d-fcf1-40f2-88f8-90a148077a78 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.085239 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-57ec111d-fcf1-40f2-88f8-90a148077a78 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.086151 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-57ec111d-fcf1-40f2-88f8-90a148077a78 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.093514 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-57ec111d-fcf1-40f2-88f8-90a148077a78 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.094609 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-57ec111d-fcf1-40f2-88f8-90a148077a78 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.222736 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-57ec111d-fcf1-40f2-88f8-90a148077a78 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:10.234671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-57ec111d-fcf1-40f2-88f8-90a148077a78 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1294 microversion: 2.1 time: 0.192253 Oct 14 03:08:10.235580 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 34/70] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:10 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1294 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:10.608637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-759216c9-73c1-4ea5-8c67-72ef3dfffc2e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:10.610453 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-759216c9-73c1-4ea5-8c67-72ef3dfffc2e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:10.625102 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-759216c9-73c1-4ea5-8c67-72ef3dfffc2e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.628368 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-759216c9-73c1-4ea5-8c67-72ef3dfffc2e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.628368 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-759216c9-73c1-4ea5-8c67-72ef3dfffc2e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.628368 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-759216c9-73c1-4ea5-8c67-72ef3dfffc2e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.628368 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-759216c9-73c1-4ea5-8c67-72ef3dfffc2e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.629098 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-759216c9-73c1-4ea5-8c67-72ef3dfffc2e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.731287 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-26f0f5ba-0cc5-4ed2-bc19-a8a7e7a704e5 req-77dc7872-30da-4c0c-a066-5956d26587e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7", "tag": "49678582-fb67-44bd-a6ab-cc4d65ebe2bc"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:10.742932 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-26f0f5ba-0cc5-4ed2-bc19-a8a7e7a704e5 req-77dc7872-30da-4c0c-a066-5956d26587e1 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.742932 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-26f0f5ba-0cc5-4ed2-bc19-a8a7e7a704e5 req-77dc7872-30da-4c0c-a066-5956d26587e1 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.742932 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-26f0f5ba-0cc5-4ed2-bc19-a8a7e7a704e5 req-77dc7872-30da-4c0c-a066-5956d26587e1 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.757442 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-26f0f5ba-0cc5-4ed2-bc19-a8a7e7a704e5 req-77dc7872-30da-4c0c-a066-5956d26587e1 service nova] Creating event network-changed:49678582-fb67-44bd-a6ab-cc4d65ebe2bc for instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 on hv-cinder-80152 Oct 14 03:08:10.763908 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-26f0f5ba-0cc5-4ed2-bc19-a8a7e7a704e5 req-77dc7872-30da-4c0c-a066-5956d26587e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133873 Oct 14 03:08:10.765341 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 35/71] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:10.817651 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-707de067-35e7-454b-9d77-62e829f95d27 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:10.817651 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-707de067-35e7-454b-9d77-62e829f95d27 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:10.851872 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-707de067-35e7-454b-9d77-62e829f95d27 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.852792 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-707de067-35e7-454b-9d77-62e829f95d27 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.853513 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-707de067-35e7-454b-9d77-62e829f95d27 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.854553 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-707de067-35e7-454b-9d77-62e829f95d27 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.855169 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-707de067-35e7-454b-9d77-62e829f95d27 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.855757 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-707de067-35e7-454b-9d77-62e829f95d27 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.300865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-707de067-35e7-454b-9d77-62e829f95d27 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:11.305231 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=79 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:11.312616 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-707de067-35e7-454b-9d77-62e829f95d27 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 0.503849 Oct 14 03:08:11.331776 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 36/72] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:10 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:11.338158 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f002d10b-b8b0-44ad-afda-e69fcdbfe94e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:11.339149 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f002d10b-b8b0-44ad-afda-e69fcdbfe94e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:11.345887 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f002d10b-b8b0-44ad-afda-e69fcdbfe94e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.346696 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f002d10b-b8b0-44ad-afda-e69fcdbfe94e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.348010 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f002d10b-b8b0-44ad-afda-e69fcdbfe94e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.348977 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f002d10b-b8b0-44ad-afda-e69fcdbfe94e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.349442 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f002d10b-b8b0-44ad-afda-e69fcdbfe94e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.349869 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f002d10b-b8b0-44ad-afda-e69fcdbfe94e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.363812 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-759216c9-73c1-4ea5-8c67-72ef3dfffc2e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:11.375141 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-759216c9-73c1-4ea5-8c67-72ef3dfffc2e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1362 microversion: 2.1 time: 0.772270 Oct 14 03:08:11.389750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 37/73] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:10 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1362 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:11.398994 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b8db34aa-3ced-4cdb-af46-55173670fa83 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:11.400143 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b8db34aa-3ced-4cdb-af46-55173670fa83 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:11.406269 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b8db34aa-3ced-4cdb-af46-55173670fa83 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.406763 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b8db34aa-3ced-4cdb-af46-55173670fa83 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.407356 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b8db34aa-3ced-4cdb-af46-55173670fa83 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.408065 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b8db34aa-3ced-4cdb-af46-55173670fa83 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.408555 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b8db34aa-3ced-4cdb-af46-55173670fa83 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.409185 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b8db34aa-3ced-4cdb-af46-55173670fa83 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.474399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-f002d10b-b8b0-44ad-afda-e69fcdbfe94e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:11.483381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-f002d10b-b8b0-44ad-afda-e69fcdbfe94e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:11.484848 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-f002d10b-b8b0-44ad-afda-e69fcdbfe94e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:11.486374 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f002d10b-b8b0-44ad-afda-e69fcdbfe94e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1340 microversion: 2.20 time: 0.153001 Oct 14 03:08:11.487127 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 37/74] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:11 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1340 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:11.492009 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-10d77e2a-eb34-482f-990d-cad68128288e req-58cbad96-89e8-46ab-a9af-717939ba4874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62bd9290-c0f1-4e49-ac21-ffaad0578417", "tag": "c4abf7d1-aa6f-4741-8265-17cd3e45f02e"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:11.514113 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-10d77e2a-eb34-482f-990d-cad68128288e req-58cbad96-89e8-46ab-a9af-717939ba4874 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.514830 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-10d77e2a-eb34-482f-990d-cad68128288e req-58cbad96-89e8-46ab-a9af-717939ba4874 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.515421 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-10d77e2a-eb34-482f-990d-cad68128288e req-58cbad96-89e8-46ab-a9af-717939ba4874 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.532556 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-10d77e2a-eb34-482f-990d-cad68128288e req-58cbad96-89e8-46ab-a9af-717939ba4874 service nova] Creating event network-changed:c4abf7d1-aa6f-4741-8265-17cd3e45f02e for instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 on hv-cinder-80152 Oct 14 03:08:11.540089 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-10d77e2a-eb34-482f-990d-cad68128288e req-58cbad96-89e8-46ab-a9af-717939ba4874 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049854 Oct 14 03:08:11.540089 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 38/75] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:11.545316 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-66f80b30-680c-4870-bdce-b31c32f2b05c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:11.546800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-66f80b30-680c-4870-bdce-b31c32f2b05c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:11.553404 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66f80b30-680c-4870-bdce-b31c32f2b05c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.554170 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66f80b30-680c-4870-bdce-b31c32f2b05c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.554753 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66f80b30-680c-4870-bdce-b31c32f2b05c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.555961 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66f80b30-680c-4870-bdce-b31c32f2b05c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.556598 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66f80b30-680c-4870-bdce-b31c32f2b05c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.557188 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66f80b30-680c-4870-bdce-b31c32f2b05c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.651499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-66f80b30-680c-4870-bdce-b31c32f2b05c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:11.653432 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b8db34aa-3ced-4cdb-af46-55173670fa83 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:11.666133 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b8db34aa-3ced-4cdb-af46-55173670fa83 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1321 microversion: 2.1 time: 0.273257 Oct 14 03:08:11.672210 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-66f80b30-680c-4870-bdce-b31c32f2b05c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1312 microversion: 2.1 time: 0.131074 Oct 14 03:08:11.672987 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 39/76] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:11 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1312 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:11.688835 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 38/77] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:11 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:12.339643 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b3edc201-fc75-4e8c-84ac-0599997e2e6f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:12.340256 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b3edc201-fc75-4e8c-84ac-0599997e2e6f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:12.347487 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3edc201-fc75-4e8c-84ac-0599997e2e6f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.347974 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3edc201-fc75-4e8c-84ac-0599997e2e6f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.348412 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3edc201-fc75-4e8c-84ac-0599997e2e6f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:12.349117 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3edc201-fc75-4e8c-84ac-0599997e2e6f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.349567 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3edc201-fc75-4e8c-84ac-0599997e2e6f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.350186 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3edc201-fc75-4e8c-84ac-0599997e2e6f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:12.412464 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-4c34c6f8-a4dd-4cf8-8d88-ea8ceb571a79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:12.415994 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-4c34c6f8-a4dd-4cf8-8d88-ea8ceb571a79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:12.424537 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c34c6f8-a4dd-4cf8-8d88-ea8ceb571a79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.426217 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c34c6f8-a4dd-4cf8-8d88-ea8ceb571a79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.426919 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c34c6f8-a4dd-4cf8-8d88-ea8ceb571a79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:12.427878 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c34c6f8-a4dd-4cf8-8d88-ea8ceb571a79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.428363 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c34c6f8-a4dd-4cf8-8d88-ea8ceb571a79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.428988 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c34c6f8-a4dd-4cf8-8d88-ea8ceb571a79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:12.627219 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b3edc201-fc75-4e8c-84ac-0599997e2e6f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:12.639922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b3edc201-fc75-4e8c-84ac-0599997e2e6f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 0.303211 Oct 14 03:08:12.652223 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 40/78] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:12 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:12.665644 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-512c1509-8e6b-4d6f-83b1-b6d48ccec8ed tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:12.666567 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-512c1509-8e6b-4d6f-83b1-b6d48ccec8ed tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:12.677639 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-512c1509-8e6b-4d6f-83b1-b6d48ccec8ed tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.679950 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-512c1509-8e6b-4d6f-83b1-b6d48ccec8ed tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.680680 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-512c1509-8e6b-4d6f-83b1-b6d48ccec8ed tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:12.681695 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-512c1509-8e6b-4d6f-83b1-b6d48ccec8ed tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.682921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-512c1509-8e6b-4d6f-83b1-b6d48ccec8ed tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.685181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-512c1509-8e6b-4d6f-83b1-b6d48ccec8ed tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:12.837425 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4c34c6f8-a4dd-4cf8-8d88-ea8ceb571a79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:12.842928 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=100 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:12.855415 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-4c34c6f8-a4dd-4cf8-8d88-ea8ceb571a79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1362 microversion: 2.1 time: 0.453611 Oct 14 03:08:12.871031 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 39/79] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:12 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1362 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:12.885709 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-05c51c30-6ab0-4b50-ad4d-d75e3b4607cb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:12.888512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-05c51c30-6ab0-4b50-ad4d-d75e3b4607cb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:12.906639 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05c51c30-6ab0-4b50-ad4d-d75e3b4607cb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.909267 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05c51c30-6ab0-4b50-ad4d-d75e3b4607cb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.910849 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05c51c30-6ab0-4b50-ad4d-d75e3b4607cb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:12.911809 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05c51c30-6ab0-4b50-ad4d-d75e3b4607cb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.913456 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05c51c30-6ab0-4b50-ad4d-d75e3b4607cb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.914075 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05c51c30-6ab0-4b50-ad4d-d75e3b4607cb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:12.927715 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-512c1509-8e6b-4d6f-83b1-b6d48ccec8ed tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:12.943047 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-512c1509-8e6b-4d6f-83b1-b6d48ccec8ed tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:12.945338 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-512c1509-8e6b-4d6f-83b1-b6d48ccec8ed tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:12.950028 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-512c1509-8e6b-4d6f-83b1-b6d48ccec8ed tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.296473 Oct 14 03:08:12.953972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 41/80] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:12 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:12.965584 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ec547b10-aa66-4a14-a7ee-ecd8467688bd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:12.968059 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ec547b10-aa66-4a14-a7ee-ecd8467688bd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:12.986226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ec547b10-aa66-4a14-a7ee-ecd8467688bd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.988448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ec547b10-aa66-4a14-a7ee-ecd8467688bd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.989105 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ec547b10-aa66-4a14-a7ee-ecd8467688bd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:12.990104 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ec547b10-aa66-4a14-a7ee-ecd8467688bd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.990746 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ec547b10-aa66-4a14-a7ee-ecd8467688bd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.993962 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ec547b10-aa66-4a14-a7ee-ecd8467688bd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:13.153429 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ec547b10-aa66-4a14-a7ee-ecd8467688bd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:13.166803 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ec547b10-aa66-4a14-a7ee-ecd8467688bd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1300 microversion: 2.1 time: 0.211522 Oct 14 03:08:13.184938 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 42/81] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:12 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1300 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:13.193078 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-1401952b-5a3a-4317-bef9-1b607c381743 req-a89a5135-4ce4-4927-a9da-6a73cfff4c89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eba7914-770c-4046-8f3d-9aebbe748f2d", "tag": "7fd90ce6-674c-4948-9a24-8092bd69d422"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:13.210832 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-1401952b-5a3a-4317-bef9-1b607c381743 req-a89a5135-4ce4-4927-a9da-6a73cfff4c89 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:13.212142 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-1401952b-5a3a-4317-bef9-1b607c381743 req-a89a5135-4ce4-4927-a9da-6a73cfff4c89 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:13.212837 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-1401952b-5a3a-4317-bef9-1b607c381743 req-a89a5135-4ce4-4927-a9da-6a73cfff4c89 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:13.229732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-1401952b-5a3a-4317-bef9-1b607c381743 req-a89a5135-4ce4-4927-a9da-6a73cfff4c89 service nova] Creating event network-changed:7fd90ce6-674c-4948-9a24-8092bd69d422 for instance 5eba7914-770c-4046-8f3d-9aebbe748f2d on hv-cinder-80152 Oct 14 03:08:13.237676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-1401952b-5a3a-4317-bef9-1b607c381743 req-a89a5135-4ce4-4927-a9da-6a73cfff4c89 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048723 Oct 14 03:08:13.237676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 43/82] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:13.243425 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-05c51c30-6ab0-4b50-ad4d-d75e3b4607cb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:13.255178 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-05c51c30-6ab0-4b50-ad4d-d75e3b4607cb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1321 microversion: 2.1 time: 0.382339 Oct 14 03:08:13.270677 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 40/83] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:12 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:13.663464 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-815389a5-7587-451c-a6f9-503e5ac98a6a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:13.664171 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-815389a5-7587-451c-a6f9-503e5ac98a6a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:13.673205 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-815389a5-7587-451c-a6f9-503e5ac98a6a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:13.673916 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-815389a5-7587-451c-a6f9-503e5ac98a6a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:13.674504 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-815389a5-7587-451c-a6f9-503e5ac98a6a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:13.675516 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-815389a5-7587-451c-a6f9-503e5ac98a6a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:13.675976 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-815389a5-7587-451c-a6f9-503e5ac98a6a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:13.676707 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-815389a5-7587-451c-a6f9-503e5ac98a6a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:13.901400 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9315b13e-4e3a-4c27-89c3-c48771724833 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:13.901400 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-9315b13e-4e3a-4c27-89c3-c48771724833 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:13.912505 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-815389a5-7587-451c-a6f9-503e5ac98a6a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:13.912655 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9315b13e-4e3a-4c27-89c3-c48771724833 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:13.913146 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9315b13e-4e3a-4c27-89c3-c48771724833 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:13.913594 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9315b13e-4e3a-4c27-89c3-c48771724833 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:13.914316 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9315b13e-4e3a-4c27-89c3-c48771724833 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:13.914805 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9315b13e-4e3a-4c27-89c3-c48771724833 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:13.915363 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9315b13e-4e3a-4c27-89c3-c48771724833 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:13.921924 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-815389a5-7587-451c-a6f9-503e5ac98a6a tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 0.262600 Oct 14 03:08:13.946849 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 44/84] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:13 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:13.985907 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-226834b1-8170-499e-9255-4239cde8ed3d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:13.988240 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-226834b1-8170-499e-9255-4239cde8ed3d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:14.008187 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-226834b1-8170-499e-9255-4239cde8ed3d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.008727 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-226834b1-8170-499e-9255-4239cde8ed3d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.016460 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-226834b1-8170-499e-9255-4239cde8ed3d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:14.018151 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-226834b1-8170-499e-9255-4239cde8ed3d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.024767 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-226834b1-8170-499e-9255-4239cde8ed3d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.027433 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-226834b1-8170-499e-9255-4239cde8ed3d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:14.290509 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-9315b13e-4e3a-4c27-89c3-c48771724833 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:14.298675 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9315b13e-4e3a-4c27-89c3-c48771724833 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1362 microversion: 2.1 time: 0.403569 Oct 14 03:08:14.300887 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 41/85] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:13 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:14.305261 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-226834b1-8170-499e-9255-4239cde8ed3d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:14.307541 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d4545486-5c20-4952-bd9a-05dd5ad9abbc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:14.309015 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d4545486-5c20-4952-bd9a-05dd5ad9abbc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:14.310906 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=4 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:14.315881 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d4545486-5c20-4952-bd9a-05dd5ad9abbc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.316933 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d4545486-5c20-4952-bd9a-05dd5ad9abbc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.317373 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d4545486-5c20-4952-bd9a-05dd5ad9abbc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:14.318074 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d4545486-5c20-4952-bd9a-05dd5ad9abbc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.318526 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d4545486-5c20-4952-bd9a-05dd5ad9abbc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.319106 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d4545486-5c20-4952-bd9a-05dd5ad9abbc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:14.327943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-226834b1-8170-499e-9255-4239cde8ed3d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:14.327943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-226834b1-8170-499e-9255-4239cde8ed3d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:14.327943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-226834b1-8170-499e-9255-4239cde8ed3d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.347579 Oct 14 03:08:14.328186 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 45/86] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:13 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:14.331951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6ef3a355-fc04-491f-b1e0-36f38ca1477a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:14.333470 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6ef3a355-fc04-491f-b1e0-36f38ca1477a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:14.338884 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=8 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:14.341859 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6ef3a355-fc04-491f-b1e0-36f38ca1477a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.342524 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6ef3a355-fc04-491f-b1e0-36f38ca1477a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.343106 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6ef3a355-fc04-491f-b1e0-36f38ca1477a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:14.344142 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6ef3a355-fc04-491f-b1e0-36f38ca1477a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.344860 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6ef3a355-fc04-491f-b1e0-36f38ca1477a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.345480 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6ef3a355-fc04-491f-b1e0-36f38ca1477a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:14.582412 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d4545486-5c20-4952-bd9a-05dd5ad9abbc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:14.590985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d4545486-5c20-4952-bd9a-05dd5ad9abbc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.288774 Oct 14 03:08:14.593984 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 42/87] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:14 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:14.620357 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6ef3a355-fc04-491f-b1e0-36f38ca1477a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:14.628671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6ef3a355-fc04-491f-b1e0-36f38ca1477a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1321 microversion: 2.1 time: 0.301127 Oct 14 03:08:14.629255 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 46/88] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:14 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:14.952467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b9f2e03a-652e-4803-87ff-890b8d9d1ea8 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:14.952986 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b9f2e03a-652e-4803-87ff-890b8d9d1ea8 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:14.959205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b9f2e03a-652e-4803-87ff-890b8d9d1ea8 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.959689 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b9f2e03a-652e-4803-87ff-890b8d9d1ea8 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.962297 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b9f2e03a-652e-4803-87ff-890b8d9d1ea8 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:14.962297 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b9f2e03a-652e-4803-87ff-890b8d9d1ea8 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.962297 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b9f2e03a-652e-4803-87ff-890b8d9d1ea8 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.962297 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b9f2e03a-652e-4803-87ff-890b8d9d1ea8 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.248321 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b9f2e03a-652e-4803-87ff-890b8d9d1ea8 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:15.264019 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b9f2e03a-652e-4803-87ff-890b8d9d1ea8 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 0.319899 Oct 14 03:08:15.266407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 43/89] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:14 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:15.272022 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-4330137f-a762-4584-b8fc-b70bfc56eeaf req-04d48aac-2b8e-4155-a8e8-ddc482a0979f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866d9750-81fa-4eba-a3b7-b1c1182ed24d", "tag": "846e0443-12a3-4f37-a28b-a559f43fd6b4"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:15.285437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-4330137f-a762-4584-b8fc-b70bfc56eeaf req-04d48aac-2b8e-4155-a8e8-ddc482a0979f service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.286131 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-4330137f-a762-4584-b8fc-b70bfc56eeaf req-04d48aac-2b8e-4155-a8e8-ddc482a0979f service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.286733 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-4330137f-a762-4584-b8fc-b70bfc56eeaf req-04d48aac-2b8e-4155-a8e8-ddc482a0979f service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.298079 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-4330137f-a762-4584-b8fc-b70bfc56eeaf req-04d48aac-2b8e-4155-a8e8-ddc482a0979f service nova] Creating event network-changed:846e0443-12a3-4f37-a28b-a559f43fd6b4 for instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d on hv-cinder-80152 Oct 14 03:08:15.304035 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-4330137f-a762-4584-b8fc-b70bfc56eeaf req-04d48aac-2b8e-4155-a8e8-ddc482a0979f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036457 Oct 14 03:08:15.305255 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 47/90] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:08:15.327947 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a2f2cfb5-b775-401e-9667-7faae57b70d1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:15.328631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a2f2cfb5-b775-401e-9667-7faae57b70d1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:15.336339 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a2f2cfb5-b775-401e-9667-7faae57b70d1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.337248 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a2f2cfb5-b775-401e-9667-7faae57b70d1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.337719 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a2f2cfb5-b775-401e-9667-7faae57b70d1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.338415 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a2f2cfb5-b775-401e-9667-7faae57b70d1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.338905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a2f2cfb5-b775-401e-9667-7faae57b70d1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.339335 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a2f2cfb5-b775-401e-9667-7faae57b70d1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.363044 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-270be57d-a642-4bbe-9952-f188e38f7f53 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:15.364427 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-270be57d-a642-4bbe-9952-f188e38f7f53 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:15.372227 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-270be57d-a642-4bbe-9952-f188e38f7f53 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.372982 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-270be57d-a642-4bbe-9952-f188e38f7f53 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.373561 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-270be57d-a642-4bbe-9952-f188e38f7f53 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.374560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-270be57d-a642-4bbe-9952-f188e38f7f53 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.377090 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-270be57d-a642-4bbe-9952-f188e38f7f53 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.377090 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-270be57d-a642-4bbe-9952-f188e38f7f53 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.619530 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a2f2cfb5-b775-401e-9667-7faae57b70d1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:15.634296 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a2f2cfb5-b775-401e-9667-7faae57b70d1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1362 microversion: 2.1 time: 0.311863 Oct 14 03:08:15.634872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 44/91] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:15 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:15.652213 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5cdff53c-98b6-49ca-8818-9311873358c5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:15.669144 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5cdff53c-98b6-49ca-8818-9311873358c5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:15.675301 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5cdff53c-98b6-49ca-8818-9311873358c5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.675790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5cdff53c-98b6-49ca-8818-9311873358c5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.676221 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5cdff53c-98b6-49ca-8818-9311873358c5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.676949 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5cdff53c-98b6-49ca-8818-9311873358c5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.677399 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5cdff53c-98b6-49ca-8818-9311873358c5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.677820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5cdff53c-98b6-49ca-8818-9311873358c5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.773194 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-270be57d-a642-4bbe-9952-f188e38f7f53 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:15.792439 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-270be57d-a642-4bbe-9952-f188e38f7f53 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:15.794094 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-270be57d-a642-4bbe-9952-f188e38f7f53 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:15.798275 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-270be57d-a642-4bbe-9952-f188e38f7f53 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.443797 Oct 14 03:08:15.800559 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 48/92] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:15 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:15.810622 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-31e2635c-763e-4b71-827b-3984262d999f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:15.814961 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-31e2635c-763e-4b71-827b-3984262d999f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:15.827695 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-31e2635c-763e-4b71-827b-3984262d999f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.828199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-31e2635c-763e-4b71-827b-3984262d999f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.828664 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-31e2635c-763e-4b71-827b-3984262d999f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.829722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-31e2635c-763e-4b71-827b-3984262d999f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.830329 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-31e2635c-763e-4b71-827b-3984262d999f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.831440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-31e2635c-763e-4b71-827b-3984262d999f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.066039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5cdff53c-98b6-49ca-8818-9311873358c5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:16.076743 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5cdff53c-98b6-49ca-8818-9311873358c5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.440652 Oct 14 03:08:16.080485 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 45/93] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:15 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:16.129607 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-31e2635c-763e-4b71-827b-3984262d999f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:16.138998 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-31e2635c-763e-4b71-827b-3984262d999f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1321 microversion: 2.1 time: 0.335555 Oct 14 03:08:16.138998 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 49/94] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:15 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:16.293205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-029b771c-4b22-4350-939d-5574c1b9ba89 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:16.293933 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-029b771c-4b22-4350-939d-5574c1b9ba89 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:16.302003 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-029b771c-4b22-4350-939d-5574c1b9ba89 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.302630 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-029b771c-4b22-4350-939d-5574c1b9ba89 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.303159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-029b771c-4b22-4350-939d-5574c1b9ba89 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.304131 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-029b771c-4b22-4350-939d-5574c1b9ba89 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.305145 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-029b771c-4b22-4350-939d-5574c1b9ba89 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.305652 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-029b771c-4b22-4350-939d-5574c1b9ba89 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.326386 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-4aa2f2b6-ddbb-4cae-b637-ffee81fbad76 req-819b3d2e-a611-4ac1-b315-7a6ce8e239ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f00fbd-d2ed-4c85-b341-8b02b1c2c20d", "tag": "26a9671e-04c8-470f-828a-9f6aa76bb214"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:16.331317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=36 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:16.338812 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-4aa2f2b6-ddbb-4cae-b637-ffee81fbad76 req-819b3d2e-a611-4ac1-b315-7a6ce8e239ed service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.339538 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-4aa2f2b6-ddbb-4cae-b637-ffee81fbad76 req-819b3d2e-a611-4ac1-b315-7a6ce8e239ed service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.340304 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-4aa2f2b6-ddbb-4cae-b637-ffee81fbad76 req-819b3d2e-a611-4ac1-b315-7a6ce8e239ed service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.354876 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-4aa2f2b6-ddbb-4cae-b637-ffee81fbad76 req-819b3d2e-a611-4ac1-b315-7a6ce8e239ed service nova] Creating event network-changed:26a9671e-04c8-470f-828a-9f6aa76bb214 for instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d on hv-cinder-80152 Oct 14 03:08:16.360325 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-4aa2f2b6-ddbb-4cae-b637-ffee81fbad76 req-819b3d2e-a611-4ac1-b315-7a6ce8e239ed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037514 Oct 14 03:08:16.361383 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 50/95] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:16.461090 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-029b771c-4b22-4350-939d-5574c1b9ba89 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:16.468648 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-029b771c-4b22-4350-939d-5574c1b9ba89 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 0.184304 Oct 14 03:08:16.469692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 46/96] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:16 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:16.666377 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9222cffc-f896-444f-b0a0-dfd7d0eca897 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:16.667396 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9222cffc-f896-444f-b0a0-dfd7d0eca897 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:16.681453 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9222cffc-f896-444f-b0a0-dfd7d0eca897 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.681932 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9222cffc-f896-444f-b0a0-dfd7d0eca897 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.685175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9222cffc-f896-444f-b0a0-dfd7d0eca897 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.685933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9222cffc-f896-444f-b0a0-dfd7d0eca897 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.687957 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9222cffc-f896-444f-b0a0-dfd7d0eca897 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.688299 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9222cffc-f896-444f-b0a0-dfd7d0eca897 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.823103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0e07b507-a33d-4b55-926b-5f438dda3df5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:16.824490 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0e07b507-a33d-4b55-926b-5f438dda3df5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:16.834586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0e07b507-a33d-4b55-926b-5f438dda3df5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.835090 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0e07b507-a33d-4b55-926b-5f438dda3df5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.835528 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0e07b507-a33d-4b55-926b-5f438dda3df5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.836440 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0e07b507-a33d-4b55-926b-5f438dda3df5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.847535 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0e07b507-a33d-4b55-926b-5f438dda3df5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.848310 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0e07b507-a33d-4b55-926b-5f438dda3df5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:17.236005 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9222cffc-f896-444f-b0a0-dfd7d0eca897 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:17.246139 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9222cffc-f896-444f-b0a0-dfd7d0eca897 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1362 microversion: 2.1 time: 0.584066 Oct 14 03:08:17.270402 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 51/97] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:16 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:17.289086 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-af2a7d6b-d133-4d05-af6d-ca707b525259 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:17.289702 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-af2a7d6b-d133-4d05-af6d-ca707b525259 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:17.303336 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af2a7d6b-d133-4d05-af6d-ca707b525259 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:17.305340 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af2a7d6b-d133-4d05-af6d-ca707b525259 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:17.306084 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af2a7d6b-d133-4d05-af6d-ca707b525259 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:17.309001 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af2a7d6b-d133-4d05-af6d-ca707b525259 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:17.310376 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af2a7d6b-d133-4d05-af6d-ca707b525259 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:17.312143 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af2a7d6b-d133-4d05-af6d-ca707b525259 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:17.317657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0e07b507-a33d-4b55-926b-5f438dda3df5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:17.335188 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0e07b507-a33d-4b55-926b-5f438dda3df5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:17.337838 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0e07b507-a33d-4b55-926b-5f438dda3df5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:17.339419 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0e07b507-a33d-4b55-926b-5f438dda3df5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.520173 Oct 14 03:08:17.340369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 47/98] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:16 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:17.351842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8f810ee3-e769-4819-a0de-9fff6a2d5c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:17.351842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8f810ee3-e769-4819-a0de-9fff6a2d5c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:17.365042 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8f810ee3-e769-4819-a0de-9fff6a2d5c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:17.365638 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8f810ee3-e769-4819-a0de-9fff6a2d5c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:17.366090 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8f810ee3-e769-4819-a0de-9fff6a2d5c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:17.367004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8f810ee3-e769-4819-a0de-9fff6a2d5c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:17.367861 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8f810ee3-e769-4819-a0de-9fff6a2d5c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:17.368518 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8f810ee3-e769-4819-a0de-9fff6a2d5c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:17.708069 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:17.741040 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8f810ee3-e769-4819-a0de-9fff6a2d5c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:17.756572 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8f810ee3-e769-4819-a0de-9fff6a2d5c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1321 microversion: 2.1 time: 0.406826 Oct 14 03:08:17.761956 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 48/99] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:17 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:17.777304 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-4c784e63-a06a-443a-8433-a626f635ae9f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:17.778022 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-4c784e63-a06a-443a-8433-a626f635ae9f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:17.790630 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c784e63-a06a-443a-8433-a626f635ae9f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:17.790746 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c784e63-a06a-443a-8433-a626f635ae9f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:17.791787 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-af2a7d6b-d133-4d05-af6d-ca707b525259 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:17.795416 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c784e63-a06a-443a-8433-a626f635ae9f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:17.796502 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c784e63-a06a-443a-8433-a626f635ae9f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:17.797137 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c784e63-a06a-443a-8433-a626f635ae9f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:17.797725 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c784e63-a06a-443a-8433-a626f635ae9f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:17.807569 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-af2a7d6b-d133-4d05-af6d-ca707b525259 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.534319 Oct 14 03:08:17.809199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 52/100] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:17 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:18.101766 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4c784e63-a06a-443a-8433-a626f635ae9f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:18.111317 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-4c784e63-a06a-443a-8433-a626f635ae9f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 0.351693 Oct 14 03:08:18.113563 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 49/101] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:17 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:18.270762 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c2701ad8-b08a-4ea2-a1b0-48b31aa4ead3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:18.271754 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c2701ad8-b08a-4ea2-a1b0-48b31aa4ead3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:18.281469 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c2701ad8-b08a-4ea2-a1b0-48b31aa4ead3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.285042 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c2701ad8-b08a-4ea2-a1b0-48b31aa4ead3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.285708 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c2701ad8-b08a-4ea2-a1b0-48b31aa4ead3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.286617 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c2701ad8-b08a-4ea2-a1b0-48b31aa4ead3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.289982 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c2701ad8-b08a-4ea2-a1b0-48b31aa4ead3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.290630 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c2701ad8-b08a-4ea2-a1b0-48b31aa4ead3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.378927 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-825cd04a-110d-43b9-868f-18045c1e5e90 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:18.379531 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-825cd04a-110d-43b9-868f-18045c1e5e90 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:18.387666 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-825cd04a-110d-43b9-868f-18045c1e5e90 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.391365 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-825cd04a-110d-43b9-868f-18045c1e5e90 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.392006 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-825cd04a-110d-43b9-868f-18045c1e5e90 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.392944 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-825cd04a-110d-43b9-868f-18045c1e5e90 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.399458 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-825cd04a-110d-43b9-868f-18045c1e5e90 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.400777 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-825cd04a-110d-43b9-868f-18045c1e5e90 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.646243 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c2701ad8-b08a-4ea2-a1b0-48b31aa4ead3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:18.661778 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c2701ad8-b08a-4ea2-a1b0-48b31aa4ead3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1362 microversion: 2.1 time: 0.394732 Oct 14 03:08:18.662684 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 53/102] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:18 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1362 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:18.706135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-825cd04a-110d-43b9-868f-18045c1e5e90 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:18.714476 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-825cd04a-110d-43b9-868f-18045c1e5e90 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:18.715924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-825cd04a-110d-43b9-868f-18045c1e5e90 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:18.717209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-825cd04a-110d-43b9-868f-18045c1e5e90 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.342066 Oct 14 03:08:18.740819 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 50/103] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:18 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:18.748976 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-3952696b-b669-4dc5-b240-8042b7ad7438 req-78ef74fe-b125-4777-a809-2232b9b5d00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07aa0f1c-fa6a-478f-8b84-cf8124621ab3", "name": "network-vif-plugged", "status": "completed", "tag": "716fa502-e091-4124-9f6f-e98fb49bb739"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:18.759648 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-3952696b-b669-4dc5-b240-8042b7ad7438 req-78ef74fe-b125-4777-a809-2232b9b5d00f service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.760264 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-3952696b-b669-4dc5-b240-8042b7ad7438 req-78ef74fe-b125-4777-a809-2232b9b5d00f service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.760890 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-3952696b-b669-4dc5-b240-8042b7ad7438 req-78ef74fe-b125-4777-a809-2232b9b5d00f service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.774436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-3952696b-b669-4dc5-b240-8042b7ad7438 req-78ef74fe-b125-4777-a809-2232b9b5d00f service nova] Creating event network-vif-plugged:716fa502-e091-4124-9f6f-e98fb49bb739 for instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 on hv-cinder-80152 Oct 14 03:08:18.782829 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a92ee1e6-2ad4-4a98-86cb-7004f1e58097 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:18.783806 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a92ee1e6-2ad4-4a98-86cb-7004f1e58097 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:18.792964 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a92ee1e6-2ad4-4a98-86cb-7004f1e58097 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.793565 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a92ee1e6-2ad4-4a98-86cb-7004f1e58097 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.794068 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a92ee1e6-2ad4-4a98-86cb-7004f1e58097 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.794619 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-3952696b-b669-4dc5-b240-8042b7ad7438 req-78ef74fe-b125-4777-a809-2232b9b5d00f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130346 Oct 14 03:08:18.795096 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a92ee1e6-2ad4-4a98-86cb-7004f1e58097 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.795498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a92ee1e6-2ad4-4a98-86cb-7004f1e58097 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.796501 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a92ee1e6-2ad4-4a98-86cb-7004f1e58097 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.796925 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 54/104] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:18.847218 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-06eddd8a-1787-4fb6-9f91-77aa4ef8ab07 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:18.856861 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-06eddd8a-1787-4fb6-9f91-77aa4ef8ab07 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:18.871402 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06eddd8a-1787-4fb6-9f91-77aa4ef8ab07 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.873430 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06eddd8a-1787-4fb6-9f91-77aa4ef8ab07 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.878653 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06eddd8a-1787-4fb6-9f91-77aa4ef8ab07 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.879481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06eddd8a-1787-4fb6-9f91-77aa4ef8ab07 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.880024 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06eddd8a-1787-4fb6-9f91-77aa4ef8ab07 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.880577 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06eddd8a-1787-4fb6-9f91-77aa4ef8ab07 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.137139 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a92ee1e6-2ad4-4a98-86cb-7004f1e58097 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:19.147093 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a92ee1e6-2ad4-4a98-86cb-7004f1e58097 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1321 microversion: 2.1 time: 0.368637 Oct 14 03:08:19.164898 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 51/105] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:18 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:19.171842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-6df44f23-b1ea-432d-861a-7e98efd12c51 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:19.172726 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-6df44f23-b1ea-432d-861a-7e98efd12c51 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:19.179340 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6df44f23-b1ea-432d-861a-7e98efd12c51 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:19.180209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6df44f23-b1ea-432d-861a-7e98efd12c51 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:19.180940 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6df44f23-b1ea-432d-861a-7e98efd12c51 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.182210 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6df44f23-b1ea-432d-861a-7e98efd12c51 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:19.183011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6df44f23-b1ea-432d-861a-7e98efd12c51 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:19.183928 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6df44f23-b1ea-432d-861a-7e98efd12c51 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.265561 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-06eddd8a-1787-4fb6-9f91-77aa4ef8ab07 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:19.274815 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-06eddd8a-1787-4fb6-9f91-77aa4ef8ab07 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.433950 Oct 14 03:08:19.275630 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 55/106] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:18 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:19.367806 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-6df44f23-b1ea-432d-861a-7e98efd12c51 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:19.379488 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-6df44f23-b1ea-432d-861a-7e98efd12c51 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 0.213081 Oct 14 03:08:19.384670 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 52/107] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:19 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:19.687116 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6d3882f9-526a-404c-8f30-58a72de86176 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:19.687722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6d3882f9-526a-404c-8f30-58a72de86176 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:19.695494 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d3882f9-526a-404c-8f30-58a72de86176 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:19.696199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d3882f9-526a-404c-8f30-58a72de86176 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:19.696860 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d3882f9-526a-404c-8f30-58a72de86176 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.697800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d3882f9-526a-404c-8f30-58a72de86176 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:19.698462 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d3882f9-526a-404c-8f30-58a72de86176 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:19.699112 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d3882f9-526a-404c-8f30-58a72de86176 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.747986 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-50bd9eb0-8410-449a-8ca8-3174b2ec75e0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:19.748719 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-50bd9eb0-8410-449a-8ca8-3174b2ec75e0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:19.757165 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-50bd9eb0-8410-449a-8ca8-3174b2ec75e0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:19.758571 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-50bd9eb0-8410-449a-8ca8-3174b2ec75e0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:19.759538 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-50bd9eb0-8410-449a-8ca8-3174b2ec75e0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.760976 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-50bd9eb0-8410-449a-8ca8-3174b2ec75e0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:19.762145 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-50bd9eb0-8410-449a-8ca8-3174b2ec75e0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:19.762862 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-50bd9eb0-8410-449a-8ca8-3174b2ec75e0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.966718 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6d3882f9-526a-404c-8f30-58a72de86176 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:19.969072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=100 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:19.975712 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6d3882f9-526a-404c-8f30-58a72de86176 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1362 microversion: 2.1 time: 0.292405 Oct 14 03:08:19.976270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 56/108] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:19 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:20.008838 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-50bd9eb0-8410-449a-8ca8-3174b2ec75e0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:20.017235 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-50bd9eb0-8410-449a-8ca8-3174b2ec75e0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:20.019339 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-50bd9eb0-8410-449a-8ca8-3174b2ec75e0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:20.020545 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-50bd9eb0-8410-449a-8ca8-3174b2ec75e0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.277808 Oct 14 03:08:20.021186 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 53/109] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:19 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:20.177271 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-521b40d0-7b35-42a1-a33d-70b44326321c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:20.178165 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-521b40d0-7b35-42a1-a33d-70b44326321c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:20.184007 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-521b40d0-7b35-42a1-a33d-70b44326321c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:20.184534 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-521b40d0-7b35-42a1-a33d-70b44326321c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:20.184973 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-521b40d0-7b35-42a1-a33d-70b44326321c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:20.185660 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-521b40d0-7b35-42a1-a33d-70b44326321c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:20.186117 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-521b40d0-7b35-42a1-a33d-70b44326321c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:20.186541 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-521b40d0-7b35-42a1-a33d-70b44326321c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:20.298055 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-483230f8-e45e-4466-b451-205953d56a38 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:20.299159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-483230f8-e45e-4466-b451-205953d56a38 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:20.306424 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-483230f8-e45e-4466-b451-205953d56a38 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:20.307204 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-483230f8-e45e-4466-b451-205953d56a38 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:20.307941 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-483230f8-e45e-4466-b451-205953d56a38 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:20.308987 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-483230f8-e45e-4466-b451-205953d56a38 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:20.309449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-483230f8-e45e-4466-b451-205953d56a38 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:20.309879 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-483230f8-e45e-4466-b451-205953d56a38 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:20.352508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-521b40d0-7b35-42a1-a33d-70b44326321c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:20.360483 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-521b40d0-7b35-42a1-a33d-70b44326321c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1321 microversion: 2.1 time: 0.187796 Oct 14 03:08:20.361070 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 57/110] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:20 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:20.407527 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-276baca6-ee94-44c3-9353-959ea5e20594 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:20.408142 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-276baca6-ee94-44c3-9353-959ea5e20594 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:20.414832 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-276baca6-ee94-44c3-9353-959ea5e20594 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:20.415319 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-276baca6-ee94-44c3-9353-959ea5e20594 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:20.415756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-276baca6-ee94-44c3-9353-959ea5e20594 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:20.416492 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-276baca6-ee94-44c3-9353-959ea5e20594 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:20.416951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-276baca6-ee94-44c3-9353-959ea5e20594 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:20.417377 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-276baca6-ee94-44c3-9353-959ea5e20594 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:20.447080 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-483230f8-e45e-4466-b451-205953d56a38 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:20.455936 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-483230f8-e45e-4466-b451-205953d56a38 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.162072 Oct 14 03:08:20.456533 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 54/111] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:20 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:20.590496 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-276baca6-ee94-44c3-9353-959ea5e20594 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:20.601361 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-276baca6-ee94-44c3-9353-959ea5e20594 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 0.197728 Oct 14 03:08:20.602020 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 58/112] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:20 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:20.998414 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-dee38f7f-86b0-4304-9ae2-1a16a7a33a4a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:20.999208 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-dee38f7f-86b0-4304-9ae2-1a16a7a33a4a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:21.005305 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dee38f7f-86b0-4304-9ae2-1a16a7a33a4a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.005778 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dee38f7f-86b0-4304-9ae2-1a16a7a33a4a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.006208 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dee38f7f-86b0-4304-9ae2-1a16a7a33a4a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.007091 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dee38f7f-86b0-4304-9ae2-1a16a7a33a4a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.007734 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dee38f7f-86b0-4304-9ae2-1a16a7a33a4a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.008163 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dee38f7f-86b0-4304-9ae2-1a16a7a33a4a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.045950 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b1149dbd-184d-40a0-993d-a4ba8ce30ded tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:21.049386 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b1149dbd-184d-40a0-993d-a4ba8ce30ded tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:21.069439 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b1149dbd-184d-40a0-993d-a4ba8ce30ded tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.070699 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b1149dbd-184d-40a0-993d-a4ba8ce30ded tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.071145 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b1149dbd-184d-40a0-993d-a4ba8ce30ded tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.072070 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b1149dbd-184d-40a0-993d-a4ba8ce30ded tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.072774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b1149dbd-184d-40a0-993d-a4ba8ce30ded tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.073344 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b1149dbd-184d-40a0-993d-a4ba8ce30ded tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.259312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-dee38f7f-86b0-4304-9ae2-1a16a7a33a4a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:21.268859 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-dee38f7f-86b0-4304-9ae2-1a16a7a33a4a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1362 microversion: 2.1 time: 0.273629 Oct 14 03:08:21.269994 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 55/113] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:20 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:21.293962 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b1149dbd-184d-40a0-993d-a4ba8ce30ded tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:21.298981 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b1149dbd-184d-40a0-993d-a4ba8ce30ded tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:21.300483 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b1149dbd-184d-40a0-993d-a4ba8ce30ded tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:21.301922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b1149dbd-184d-40a0-993d-a4ba8ce30ded tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.260421 Oct 14 03:08:21.302119 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 59/114] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:21 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:21.383626 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-89ec6f85-00fc-4d8c-80b0-5e8fcf268c5d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:21.384236 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-89ec6f85-00fc-4d8c-80b0-5e8fcf268c5d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:21.390130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-89ec6f85-00fc-4d8c-80b0-5e8fcf268c5d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.390617 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-89ec6f85-00fc-4d8c-80b0-5e8fcf268c5d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.391053 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-89ec6f85-00fc-4d8c-80b0-5e8fcf268c5d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.391742 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-89ec6f85-00fc-4d8c-80b0-5e8fcf268c5d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.392273 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-89ec6f85-00fc-4d8c-80b0-5e8fcf268c5d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.392733 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-89ec6f85-00fc-4d8c-80b0-5e8fcf268c5d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.411451 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=100 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:21.484695 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e0030db0-0f3d-4181-ad6e-b6a3573be372 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:21.485626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e0030db0-0f3d-4181-ad6e-b6a3573be372 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:21.491455 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0030db0-0f3d-4181-ad6e-b6a3573be372 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.491949 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0030db0-0f3d-4181-ad6e-b6a3573be372 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.492418 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0030db0-0f3d-4181-ad6e-b6a3573be372 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.493116 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0030db0-0f3d-4181-ad6e-b6a3573be372 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.493573 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0030db0-0f3d-4181-ad6e-b6a3573be372 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.494002 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0030db0-0f3d-4181-ad6e-b6a3573be372 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.521894 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-89ec6f85-00fc-4d8c-80b0-5e8fcf268c5d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:21.529869 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-89ec6f85-00fc-4d8c-80b0-5e8fcf268c5d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1321 microversion: 2.1 time: 0.150049 Oct 14 03:08:21.530439 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 56/115] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:21 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:21.625359 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-40b22077-b250-4a1c-be47-d29349c3acd6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:21.626329 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-40b22077-b250-4a1c-be47-d29349c3acd6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:21.634051 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-40b22077-b250-4a1c-be47-d29349c3acd6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.634542 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-40b22077-b250-4a1c-be47-d29349c3acd6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.635012 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-40b22077-b250-4a1c-be47-d29349c3acd6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.635722 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-40b22077-b250-4a1c-be47-d29349c3acd6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.636176 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-40b22077-b250-4a1c-be47-d29349c3acd6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.636296 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e0030db0-0f3d-4181-ad6e-b6a3573be372 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:21.636627 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-40b22077-b250-4a1c-be47-d29349c3acd6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.644017 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e0030db0-0f3d-4181-ad6e-b6a3573be372 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.163129 Oct 14 03:08:21.644786 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 60/116] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:21 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:21.775849 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-40b22077-b250-4a1c-be47-d29349c3acd6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:21.783907 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-40b22077-b250-4a1c-be47-d29349c3acd6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 0.163348 Oct 14 03:08:21.784993 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 57/117] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:21 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:22.038251 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-00beae8c-19e3-4725-9c11-1d87545fc6f3 req-902c60f6-a110-4c31-b7ef-d09014079df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62bd9290-c0f1-4e49-ac21-ffaad0578417", "name": "network-vif-plugged", "status": "completed", "tag": "c4abf7d1-aa6f-4741-8265-17cd3e45f02e"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:22.050004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-00beae8c-19e3-4725-9c11-1d87545fc6f3 req-902c60f6-a110-4c31-b7ef-d09014079df5 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.050655 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-00beae8c-19e3-4725-9c11-1d87545fc6f3 req-902c60f6-a110-4c31-b7ef-d09014079df5 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.050917 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-00beae8c-19e3-4725-9c11-1d87545fc6f3 req-902c60f6-a110-4c31-b7ef-d09014079df5 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.061964 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-00beae8c-19e3-4725-9c11-1d87545fc6f3 req-902c60f6-a110-4c31-b7ef-d09014079df5 service nova] Creating event network-vif-plugged:c4abf7d1-aa6f-4741-8265-17cd3e45f02e for instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 on hv-cinder-80152 Oct 14 03:08:22.067201 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-00beae8c-19e3-4725-9c11-1d87545fc6f3 req-902c60f6-a110-4c31-b7ef-d09014079df5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036977 Oct 14 03:08:22.067615 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 61/118] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:22.290877 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a54de978-dbc1-4540-a704-bb3a326757f1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:22.291735 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a54de978-dbc1-4540-a704-bb3a326757f1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:22.298070 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a54de978-dbc1-4540-a704-bb3a326757f1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.298599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a54de978-dbc1-4540-a704-bb3a326757f1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.299007 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a54de978-dbc1-4540-a704-bb3a326757f1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.299777 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a54de978-dbc1-4540-a704-bb3a326757f1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.300232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a54de978-dbc1-4540-a704-bb3a326757f1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.300707 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a54de978-dbc1-4540-a704-bb3a326757f1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.327788 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3a94a105-c18d-4221-8324-74ca3817387f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:22.334044 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-3a94a105-c18d-4221-8324-74ca3817387f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:22.341188 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3a94a105-c18d-4221-8324-74ca3817387f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.341990 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3a94a105-c18d-4221-8324-74ca3817387f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.342526 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3a94a105-c18d-4221-8324-74ca3817387f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.343342 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3a94a105-c18d-4221-8324-74ca3817387f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.343965 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3a94a105-c18d-4221-8324-74ca3817387f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.344636 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3a94a105-c18d-4221-8324-74ca3817387f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.536568 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a54de978-dbc1-4540-a704-bb3a326757f1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:22.548166 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a54de978-dbc1-4540-a704-bb3a326757f1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1362 microversion: 2.1 time: 0.260960 Oct 14 03:08:22.551008 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 58/119] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:22 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:22.558914 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8b733275-dcf0-41c9-8dcb-29a74f502324 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:22.561468 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3a94a105-c18d-4221-8324-74ca3817387f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:22.565006 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8b733275-dcf0-41c9-8dcb-29a74f502324 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:22.572980 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3a94a105-c18d-4221-8324-74ca3817387f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:22.577448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3a94a105-c18d-4221-8324-74ca3817387f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:22.577448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-3a94a105-c18d-4221-8324-74ca3817387f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.252207 Oct 14 03:08:22.580994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 62/120] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:22 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:22.582913 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b733275-dcf0-41c9-8dcb-29a74f502324 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.584911 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b733275-dcf0-41c9-8dcb-29a74f502324 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.585349 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b733275-dcf0-41c9-8dcb-29a74f502324 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.586091 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b733275-dcf0-41c9-8dcb-29a74f502324 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.586842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b733275-dcf0-41c9-8dcb-29a74f502324 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.587266 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b733275-dcf0-41c9-8dcb-29a74f502324 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.668517 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-13e0a14b-50ae-4325-8820-42a8c153adb2 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:22.669485 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-13e0a14b-50ae-4325-8820-42a8c153adb2 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:22.677860 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-13e0a14b-50ae-4325-8820-42a8c153adb2 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.689271 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-13e0a14b-50ae-4325-8820-42a8c153adb2 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.689271 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-13e0a14b-50ae-4325-8820-42a8c153adb2 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.689271 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-13e0a14b-50ae-4325-8820-42a8c153adb2 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.689271 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-13e0a14b-50ae-4325-8820-42a8c153adb2 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.690206 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-13e0a14b-50ae-4325-8820-42a8c153adb2 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.911844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8b733275-dcf0-41c9-8dcb-29a74f502324 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:22.928124 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-13e0a14b-50ae-4325-8820-42a8c153adb2 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:22.936116 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-13e0a14b-50ae-4325-8820-42a8c153adb2 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.272454 Oct 14 03:08:22.936709 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8b733275-dcf0-41c9-8dcb-29a74f502324 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1321 microversion: 2.1 time: 0.380623 Oct 14 03:08:22.937344 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 63/121] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:22 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:22.938782 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 59/122] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:22 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:22.942762 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6d307015-0405-4678-98f0-bf157a6d763b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:22.944069 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6d307015-0405-4678-98f0-bf157a6d763b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:22.950292 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d307015-0405-4678-98f0-bf157a6d763b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.950871 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d307015-0405-4678-98f0-bf157a6d763b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.951371 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d307015-0405-4678-98f0-bf157a6d763b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.952131 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d307015-0405-4678-98f0-bf157a6d763b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.952679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d307015-0405-4678-98f0-bf157a6d763b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.953165 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d307015-0405-4678-98f0-bf157a6d763b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.096410 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6d307015-0405-4678-98f0-bf157a6d763b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:23.104412 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6d307015-0405-4678-98f0-bf157a6d763b tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1315 microversion: 2.1 time: 0.165909 Oct 14 03:08:23.105003 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 64/123] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:22 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:23.576214 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5a44e37d-4617-4c64-be2c-b4f1106ce878 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:23.576856 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5a44e37d-4617-4c64-be2c-b4f1106ce878 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:23.583126 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5a44e37d-4617-4c64-be2c-b4f1106ce878 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.583552 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5a44e37d-4617-4c64-be2c-b4f1106ce878 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.583987 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5a44e37d-4617-4c64-be2c-b4f1106ce878 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.584700 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5a44e37d-4617-4c64-be2c-b4f1106ce878 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.585159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5a44e37d-4617-4c64-be2c-b4f1106ce878 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.585607 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5a44e37d-4617-4c64-be2c-b4f1106ce878 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.606927 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-4bd61eeb-b578-4af9-839f-8f170ba2ad35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:23.607726 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-4bd61eeb-b578-4af9-839f-8f170ba2ad35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:23.614326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4bd61eeb-b578-4af9-839f-8f170ba2ad35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.614808 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4bd61eeb-b578-4af9-839f-8f170ba2ad35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.615243 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4bd61eeb-b578-4af9-839f-8f170ba2ad35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.615927 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4bd61eeb-b578-4af9-839f-8f170ba2ad35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.616409 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4bd61eeb-b578-4af9-839f-8f170ba2ad35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.616830 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4bd61eeb-b578-4af9-839f-8f170ba2ad35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.817105 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5a44e37d-4617-4c64-be2c-b4f1106ce878 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:23.825468 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4bd61eeb-b578-4af9-839f-8f170ba2ad35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:23.837175 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5a44e37d-4617-4c64-be2c-b4f1106ce878 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1362 microversion: 2.1 time: 0.264519 Oct 14 03:08:23.838051 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4bd61eeb-b578-4af9-839f-8f170ba2ad35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:23.852414 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 60/124] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:23 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:23.855463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4bd61eeb-b578-4af9-839f-8f170ba2ad35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:23.856687 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-4bd61eeb-b578-4af9-839f-8f170ba2ad35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.253643 Oct 14 03:08:23.858514 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 65/125] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:23 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:23.982719 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ab0ceb55-07e7-48b3-a67f-ab0206197920 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:23.983787 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ab0ceb55-07e7-48b3-a67f-ab0206197920 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:23.983910 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-7c911522-90ef-4802-bc77-f93af4b633ef tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:23.984532 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-7c911522-90ef-4802-bc77-f93af4b633ef tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:23.989923 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab0ceb55-07e7-48b3-a67f-ab0206197920 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.994507 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab0ceb55-07e7-48b3-a67f-ab0206197920 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.994507 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab0ceb55-07e7-48b3-a67f-ab0206197920 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.994507 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab0ceb55-07e7-48b3-a67f-ab0206197920 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.994507 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab0ceb55-07e7-48b3-a67f-ab0206197920 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.995033 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7c911522-90ef-4802-bc77-f93af4b633ef tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.995125 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab0ceb55-07e7-48b3-a67f-ab0206197920 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.995212 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7c911522-90ef-4802-bc77-f93af4b633ef tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.995212 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7c911522-90ef-4802-bc77-f93af4b633ef tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.995212 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7c911522-90ef-4802-bc77-f93af4b633ef tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.995212 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7c911522-90ef-4802-bc77-f93af4b633ef tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.001960 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7c911522-90ef-4802-bc77-f93af4b633ef tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.191016 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ab0ceb55-07e7-48b3-a67f-ab0206197920 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:24.201060 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7c911522-90ef-4802-bc77-f93af4b633ef tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:24.208093 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ab0ceb55-07e7-48b3-a67f-ab0206197920 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1321 microversion: 2.1 time: 0.228941 Oct 14 03:08:24.208715 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 61/126] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:23 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:24.223448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-7c911522-90ef-4802-bc77-f93af4b633ef tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.232700 Oct 14 03:08:24.223448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 66/127] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:23 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:24.223656 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c58564a1-2d42-4d0d-b9b1-cbfc365526ec tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:24.223656 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c58564a1-2d42-4d0d-b9b1-cbfc365526ec tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:24.223915 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-0026b827-7020-4338-84b1-e8d0deb5f545 req-bdb3f7cd-2025-44d2-879d-f705df1d87c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eba7914-770c-4046-8f3d-9aebbe748f2d", "name": "network-vif-plugged", "status": "completed", "tag": "7fd90ce6-674c-4948-9a24-8092bd69d422"}, {"server_uuid": "d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7", "name": "network-vif-plugged", "status": "completed", "tag": "49678582-fb67-44bd-a6ab-cc4d65ebe2bc"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:24.233866 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c58564a1-2d42-4d0d-b9b1-cbfc365526ec tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.234487 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c58564a1-2d42-4d0d-b9b1-cbfc365526ec tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.235023 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c58564a1-2d42-4d0d-b9b1-cbfc365526ec tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.236723 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c58564a1-2d42-4d0d-b9b1-cbfc365526ec tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.236896 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c58564a1-2d42-4d0d-b9b1-cbfc365526ec tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.237449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c58564a1-2d42-4d0d-b9b1-cbfc365526ec tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.238929 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-0026b827-7020-4338-84b1-e8d0deb5f545 req-bdb3f7cd-2025-44d2-879d-f705df1d87c4 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.239584 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-0026b827-7020-4338-84b1-e8d0deb5f545 req-bdb3f7cd-2025-44d2-879d-f705df1d87c4 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.240084 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-0026b827-7020-4338-84b1-e8d0deb5f545 req-bdb3f7cd-2025-44d2-879d-f705df1d87c4 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.257968 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-0026b827-7020-4338-84b1-e8d0deb5f545 req-bdb3f7cd-2025-44d2-879d-f705df1d87c4 service nova] Creating event network-vif-plugged:7fd90ce6-674c-4948-9a24-8092bd69d422 for instance 5eba7914-770c-4046-8f3d-9aebbe748f2d on hv-cinder-80152 Oct 14 03:08:24.259471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-0026b827-7020-4338-84b1-e8d0deb5f545 req-bdb3f7cd-2025-44d2-879d-f705df1d87c4 service nova] Creating event network-vif-plugged:49678582-fb67-44bd-a6ab-cc4d65ebe2bc for instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 on hv-cinder-80152 Oct 14 03:08:24.265595 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-0026b827-7020-4338-84b1-e8d0deb5f545 req-bdb3f7cd-2025-44d2-879d-f705df1d87c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049288 Oct 14 03:08:24.266996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 67/128] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:24.382091 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c58564a1-2d42-4d0d-b9b1-cbfc365526ec tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:24.390504 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c58564a1-2d42-4d0d-b9b1-cbfc365526ec tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1503 microversion: 2.1 time: 0.172618 Oct 14 03:08:24.390949 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 62/129] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:24 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:24.866691 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-747f2444-a3a3-4a8f-9257-29b7329390c1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:24.867383 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-747f2444-a3a3-4a8f-9257-29b7329390c1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:24.873621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-747f2444-a3a3-4a8f-9257-29b7329390c1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.874101 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-747f2444-a3a3-4a8f-9257-29b7329390c1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.875238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-747f2444-a3a3-4a8f-9257-29b7329390c1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.875238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-747f2444-a3a3-4a8f-9257-29b7329390c1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.875753 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-747f2444-a3a3-4a8f-9257-29b7329390c1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.876055 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-747f2444-a3a3-4a8f-9257-29b7329390c1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.892805 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-7c268d77-930f-4418-84d4-12aed20c2dbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:24.894052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-7c268d77-930f-4418-84d4-12aed20c2dbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:24.900308 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7c268d77-930f-4418-84d4-12aed20c2dbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.900836 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7c268d77-930f-4418-84d4-12aed20c2dbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.901345 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7c268d77-930f-4418-84d4-12aed20c2dbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.902095 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7c268d77-930f-4418-84d4-12aed20c2dbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.902645 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7c268d77-930f-4418-84d4-12aed20c2dbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.903074 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7c268d77-930f-4418-84d4-12aed20c2dbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:25.071948 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-747f2444-a3a3-4a8f-9257-29b7329390c1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:25.078696 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-7c268d77-930f-4418-84d4-12aed20c2dbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:25.079880 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-747f2444-a3a3-4a8f-9257-29b7329390c1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1548 microversion: 2.1 time: 0.217361 Oct 14 03:08:25.080593 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 68/130] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:24 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1548 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:25.087414 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-7c268d77-930f-4418-84d4-12aed20c2dbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:25.089117 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-7c268d77-930f-4418-84d4-12aed20c2dbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:25.090232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-7c268d77-930f-4418-84d4-12aed20c2dbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.202084 Oct 14 03:08:25.091260 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 63/131] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:24 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:25.114484 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8647b8dc-7263-4289-a9a3-7248ee541e04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:25.115678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8647b8dc-7263-4289-a9a3-7248ee541e04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:25.122059 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8647b8dc-7263-4289-a9a3-7248ee541e04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:25.123031 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8647b8dc-7263-4289-a9a3-7248ee541e04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:25.123690 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8647b8dc-7263-4289-a9a3-7248ee541e04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:25.124711 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8647b8dc-7263-4289-a9a3-7248ee541e04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:25.125179 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8647b8dc-7263-4289-a9a3-7248ee541e04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:25.125609 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8647b8dc-7263-4289-a9a3-7248ee541e04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:25.239176 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f2401421-b5e0-42d2-b5b8-b1f899990e65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:25.243471 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f2401421-b5e0-42d2-b5b8-b1f899990e65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:25.259262 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2401421-b5e0-42d2-b5b8-b1f899990e65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:25.264059 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2401421-b5e0-42d2-b5b8-b1f899990e65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:25.265269 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2401421-b5e0-42d2-b5b8-b1f899990e65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:25.269786 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2401421-b5e0-42d2-b5b8-b1f899990e65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:25.270482 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2401421-b5e0-42d2-b5b8-b1f899990e65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:25.271476 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2401421-b5e0-42d2-b5b8-b1f899990e65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:25.325173 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8647b8dc-7263-4289-a9a3-7248ee541e04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.219739 Oct 14 03:08:25.335025 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 69/132] 10.222.0.13 () {58 vars in 1275 bytes} [Fri Oct 14 03:08:25 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/os-interface => generated 284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:25.340771 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a6958565-7cd2-46d4-b91a-bd53f9cfd4c9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:25.341592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-a6958565-7cd2-46d4-b91a-bd53f9cfd4c9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:25.376185 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a6958565-7cd2-46d4-b91a-bd53f9cfd4c9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:25.376759 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a6958565-7cd2-46d4-b91a-bd53f9cfd4c9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:25.384812 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a6958565-7cd2-46d4-b91a-bd53f9cfd4c9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:25.386091 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a6958565-7cd2-46d4-b91a-bd53f9cfd4c9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:25.386750 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a6958565-7cd2-46d4-b91a-bd53f9cfd4c9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:25.387373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a6958565-7cd2-46d4-b91a-bd53f9cfd4c9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:25.589185 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f2401421-b5e0-42d2-b5b8-b1f899990e65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:25.597966 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f2401421-b5e0-42d2-b5b8-b1f899990e65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1321 microversion: 2.1 time: 0.370134 Oct 14 03:08:25.598554 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 64/133] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:25 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:25.665590 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a6958565-7cd2-46d4-b91a-bd53f9cfd4c9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:25.674922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-a6958565-7cd2-46d4-b91a-bd53f9cfd4c9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.345362 Oct 14 03:08:25.697922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 70/134] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:25 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:26.118334 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8f9b8062-4b1f-42ff-8718-4e4e0e95e7ad tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:26.119420 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8f9b8062-4b1f-42ff-8718-4e4e0e95e7ad tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:26.127948 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8f9b8062-4b1f-42ff-8718-4e4e0e95e7ad tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:26.128194 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8f9b8062-4b1f-42ff-8718-4e4e0e95e7ad tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:26.128682 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8f9b8062-4b1f-42ff-8718-4e4e0e95e7ad tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:26.129556 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8f9b8062-4b1f-42ff-8718-4e4e0e95e7ad tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:26.130097 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8f9b8062-4b1f-42ff-8718-4e4e0e95e7ad tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:26.130626 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8f9b8062-4b1f-42ff-8718-4e4e0e95e7ad tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:26.286534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8f9b8062-4b1f-42ff-8718-4e4e0e95e7ad tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:26.298582 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8f9b8062-4b1f-42ff-8718-4e4e0e95e7ad tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:26.302598 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8f9b8062-4b1f-42ff-8718-4e4e0e95e7ad tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:26.303946 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8f9b8062-4b1f-42ff-8718-4e4e0e95e7ad tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.190389 Oct 14 03:08:26.305191 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 65/135] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:26 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:26.516872 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-fdec547e-515a-4c02-8b27-c52eb48e12ef tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f6422e1-627d-4157-9efa-60cd962d27c6"}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:26.519794 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-fdec547e-515a-4c02-8b27-c52eb48e12ef tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:26.525826 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdec547e-515a-4c02-8b27-c52eb48e12ef tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:26.526316 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdec547e-515a-4c02-8b27-c52eb48e12ef tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:26.526756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdec547e-515a-4c02-8b27-c52eb48e12ef tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:26.527458 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdec547e-515a-4c02-8b27-c52eb48e12ef tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:26.527921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdec547e-515a-4c02-8b27-c52eb48e12ef tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:26.528351 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdec547e-515a-4c02-8b27-c52eb48e12ef tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:26.622143 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9eac718a-780a-4ba3-b2d5-03abdd5c2f1a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:26.622746 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-9eac718a-780a-4ba3-b2d5-03abdd5c2f1a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:26.629945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9eac718a-780a-4ba3-b2d5-03abdd5c2f1a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:26.630420 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9eac718a-780a-4ba3-b2d5-03abdd5c2f1a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:26.630852 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9eac718a-780a-4ba3-b2d5-03abdd5c2f1a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:26.631541 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9eac718a-780a-4ba3-b2d5-03abdd5c2f1a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:26.631990 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9eac718a-780a-4ba3-b2d5-03abdd5c2f1a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:26.632426 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9eac718a-780a-4ba3-b2d5-03abdd5c2f1a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:26.791214 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-9eac718a-780a-4ba3-b2d5-03abdd5c2f1a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:26.804538 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9eac718a-780a-4ba3-b2d5-03abdd5c2f1a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1321 microversion: 2.1 time: 0.185400 Oct 14 03:08:26.805643 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 66/136] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:26 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:26.810951 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f5601204-3d00-4d83-9c07-50511e1cfaad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:26.812217 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f5601204-3d00-4d83-9c07-50511e1cfaad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:26.820550 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5601204-3d00-4d83-9c07-50511e1cfaad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:26.821430 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5601204-3d00-4d83-9c07-50511e1cfaad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:26.822190 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5601204-3d00-4d83-9c07-50511e1cfaad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:26.823033 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5601204-3d00-4d83-9c07-50511e1cfaad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:26.823597 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5601204-3d00-4d83-9c07-50511e1cfaad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:26.824098 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5601204-3d00-4d83-9c07-50511e1cfaad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:26.961147 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f5601204-3d00-4d83-9c07-50511e1cfaad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:26.968863 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f5601204-3d00-4d83-9c07-50511e1cfaad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.161969 Oct 14 03:08:26.969432 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 67/137] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:26 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:27.080343 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-29669737-f4db-4411-bf47-952d6576c12f req-52f202eb-eb37-48cc-a742-a01b96f27fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62bd9290-c0f1-4e49-ac21-ffaad0578417", "tag": "c4abf7d1-aa6f-4741-8265-17cd3e45f02e"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:27.094150 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-29669737-f4db-4411-bf47-952d6576c12f req-52f202eb-eb37-48cc-a742-a01b96f27fcc service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.094643 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-29669737-f4db-4411-bf47-952d6576c12f req-52f202eb-eb37-48cc-a742-a01b96f27fcc service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.095084 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-29669737-f4db-4411-bf47-952d6576c12f req-52f202eb-eb37-48cc-a742-a01b96f27fcc service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.117350 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-29669737-f4db-4411-bf47-952d6576c12f req-52f202eb-eb37-48cc-a742-a01b96f27fcc service nova] Creating event network-changed:c4abf7d1-aa6f-4741-8265-17cd3e45f02e for instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 on hv-cinder-80152 Oct 14 03:08:27.118167 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-29669737-f4db-4411-bf47-952d6576c12f req-52f202eb-eb37-48cc-a742-a01b96f27fcc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119301) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 14 03:08:27.118715 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-29669737-f4db-4411-bf47-952d6576c12f req-52f202eb-eb37-48cc-a742-a01b96f27fcc service nova] Acquired lock "compute-rpcapi-router" {{(pid=119301) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 14 03:08:27.120549 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-070464ed-a7c5-4f01-be35-c0663ab9f35e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.121180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-070464ed-a7c5-4f01-be35-c0663ab9f35e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.121768 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-070464ed-a7c5-4f01-be35-c0663ab9f35e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.122689 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-070464ed-a7c5-4f01-be35-c0663ab9f35e None None] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.123296 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-070464ed-a7c5-4f01-be35-c0663ab9f35e None None] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.124842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-070464ed-a7c5-4f01-be35-c0663ab9f35e None None] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.135116 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.compute.rpcapi [None req-070464ed-a7c5-4f01-be35-c0663ab9f35e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 14 03:08:27.136265 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-070464ed-a7c5-4f01-be35-c0663ab9f35e None None] Releasing lock "compute-rpcapi-router" {{(pid=119301) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 14 03:08:27.153280 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-070464ed-a7c5-4f01-be35-c0663ab9f35e None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076494 Oct 14 03:08:27.154046 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 68/138] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:08:27.161802 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-16083108-c66c-4dbc-86b0-4bfbf232ae33 req-9dd594c5-0cbd-4862-8cf0-f35f46f5eaa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866d9750-81fa-4eba-a3b7-b1c1182ed24d", "name": "network-vif-plugged", "status": "completed", "tag": "846e0443-12a3-4f37-a28b-a559f43fd6b4"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:27.171454 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-16083108-c66c-4dbc-86b0-4bfbf232ae33 req-9dd594c5-0cbd-4862-8cf0-f35f46f5eaa8 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.171935 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-16083108-c66c-4dbc-86b0-4bfbf232ae33 req-9dd594c5-0cbd-4862-8cf0-f35f46f5eaa8 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.172370 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-16083108-c66c-4dbc-86b0-4bfbf232ae33 req-9dd594c5-0cbd-4862-8cf0-f35f46f5eaa8 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.183848 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-16083108-c66c-4dbc-86b0-4bfbf232ae33 req-9dd594c5-0cbd-4862-8cf0-f35f46f5eaa8 service nova] Creating event network-vif-plugged:846e0443-12a3-4f37-a28b-a559f43fd6b4 for instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d on hv-cinder-80152 Oct 14 03:08:27.188722 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-16083108-c66c-4dbc-86b0-4bfbf232ae33 req-9dd594c5-0cbd-4862-8cf0-f35f46f5eaa8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033120 Oct 14 03:08:27.189511 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 69/139] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:27.341873 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-32c9a889-c0d6-4326-bf31-70c03b5309c5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:27.343290 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-32c9a889-c0d6-4326-bf31-70c03b5309c5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:27.363722 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-32c9a889-c0d6-4326-bf31-70c03b5309c5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.363722 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-32c9a889-c0d6-4326-bf31-70c03b5309c5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.363722 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-32c9a889-c0d6-4326-bf31-70c03b5309c5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.363722 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-32c9a889-c0d6-4326-bf31-70c03b5309c5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.364029 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-32c9a889-c0d6-4326-bf31-70c03b5309c5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.364029 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-32c9a889-c0d6-4326-bf31-70c03b5309c5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.506789 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-32c9a889-c0d6-4326-bf31-70c03b5309c5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:27.519295 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-32c9a889-c0d6-4326-bf31-70c03b5309c5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:27.523313 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-32c9a889-c0d6-4326-bf31-70c03b5309c5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:27.523313 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-32c9a889-c0d6-4326-bf31-70c03b5309c5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.196054 Oct 14 03:08:27.524195 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 70/140] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:27 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:27.831276 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b9d917f1-92d5-4c77-9f50-2e0c1ecc75f7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:27.832067 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b9d917f1-92d5-4c77-9f50-2e0c1ecc75f7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:27.839205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b9d917f1-92d5-4c77-9f50-2e0c1ecc75f7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.840116 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b9d917f1-92d5-4c77-9f50-2e0c1ecc75f7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.840691 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b9d917f1-92d5-4c77-9f50-2e0c1ecc75f7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.841495 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b9d917f1-92d5-4c77-9f50-2e0c1ecc75f7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.842047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b9d917f1-92d5-4c77-9f50-2e0c1ecc75f7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.842665 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b9d917f1-92d5-4c77-9f50-2e0c1ecc75f7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.977520 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b9d917f1-92d5-4c77-9f50-2e0c1ecc75f7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:27.985789 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b9d917f1-92d5-4c77-9f50-2e0c1ecc75f7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1514 microversion: 2.1 time: 0.158767 Oct 14 03:08:27.986415 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 71/141] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:27 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:27.991011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0827a20e-12f9-4362-9cd6-dec4a0887574 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:27.991938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0827a20e-12f9-4362-9cd6-dec4a0887574 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:27.998155 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0827a20e-12f9-4362-9cd6-dec4a0887574 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.998645 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0827a20e-12f9-4362-9cd6-dec4a0887574 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:28.002449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0827a20e-12f9-4362-9cd6-dec4a0887574 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:28.002449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0827a20e-12f9-4362-9cd6-dec4a0887574 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:28.002449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0827a20e-12f9-4362-9cd6-dec4a0887574 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:28.002449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0827a20e-12f9-4362-9cd6-dec4a0887574 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:28.166307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0827a20e-12f9-4362-9cd6-dec4a0887574 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:28.174257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0827a20e-12f9-4362-9cd6-dec4a0887574 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.186655 Oct 14 03:08:28.175098 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 72/142] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:27 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:28.181796 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-4c216fb0-0010-4e27-bd64-fbbc1d89166a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:28.184863 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-4c216fb0-0010-4e27-bd64-fbbc1d89166a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:28.193468 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c216fb0-0010-4e27-bd64-fbbc1d89166a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:28.194171 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c216fb0-0010-4e27-bd64-fbbc1d89166a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:28.194774 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c216fb0-0010-4e27-bd64-fbbc1d89166a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:28.195486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c216fb0-0010-4e27-bd64-fbbc1d89166a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:28.195941 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c216fb0-0010-4e27-bd64-fbbc1d89166a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:28.196369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4c216fb0-0010-4e27-bd64-fbbc1d89166a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:28.271211 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-4c216fb0-0010-4e27-bd64-fbbc1d89166a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lazy-loading 'flavor' on Instance uuid 5eba7914-770c-4046-8f3d-9aebbe748f2d {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:08:28.335396 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=100 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:28.702983 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-4c216fb0-0010-4e27-bd64-fbbc1d89166a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "POST /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d/action" status: 200 len: 32 microversion: 2.1 time: 0.519699 Oct 14 03:08:28.702983 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 73/143] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Oct 14 03:08:28 2022] POST /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d/action => generated 32 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:08:28.707678 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f1341cb8-cede-41db-93ef-64dde9fc7b79 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:28.708686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f1341cb8-cede-41db-93ef-64dde9fc7b79 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:28.716751 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f1341cb8-cede-41db-93ef-64dde9fc7b79 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:28.717513 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f1341cb8-cede-41db-93ef-64dde9fc7b79 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:28.717961 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f1341cb8-cede-41db-93ef-64dde9fc7b79 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:28.718674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f1341cb8-cede-41db-93ef-64dde9fc7b79 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:28.719313 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f1341cb8-cede-41db-93ef-64dde9fc7b79 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:28.720042 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f1341cb8-cede-41db-93ef-64dde9fc7b79 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:28.877719 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f1341cb8-cede-41db-93ef-64dde9fc7b79 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:28.887148 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f1341cb8-cede-41db-93ef-64dde9fc7b79 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:28.893076 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f1341cb8-cede-41db-93ef-64dde9fc7b79 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:28.894210 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f1341cb8-cede-41db-93ef-64dde9fc7b79 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.192045 Oct 14 03:08:28.895234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 74/144] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:28 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:28.911083 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-59ce9717-ad5a-46a0-b71e-7c5f90d9b4f6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:28.912103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-59ce9717-ad5a-46a0-b71e-7c5f90d9b4f6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:28.918805 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59ce9717-ad5a-46a0-b71e-7c5f90d9b4f6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:28.919320 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59ce9717-ad5a-46a0-b71e-7c5f90d9b4f6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:28.919883 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59ce9717-ad5a-46a0-b71e-7c5f90d9b4f6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:28.920786 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59ce9717-ad5a-46a0-b71e-7c5f90d9b4f6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:28.921473 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59ce9717-ad5a-46a0-b71e-7c5f90d9b4f6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:28.922562 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59ce9717-ad5a-46a0-b71e-7c5f90d9b4f6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:29.092130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-59ce9717-ad5a-46a0-b71e-7c5f90d9b4f6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:29.103614 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-59ce9717-ad5a-46a0-b71e-7c5f90d9b4f6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.206469 Oct 14 03:08:29.104850 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 75/145] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:28 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:29.200898 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-104e3124-c041-4ffe-91fd-1cd5d92a1e4e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:29.202418 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-104e3124-c041-4ffe-91fd-1cd5d92a1e4e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:29.210517 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-104e3124-c041-4ffe-91fd-1cd5d92a1e4e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:29.211158 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-104e3124-c041-4ffe-91fd-1cd5d92a1e4e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:29.211793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-104e3124-c041-4ffe-91fd-1cd5d92a1e4e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:29.213493 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-104e3124-c041-4ffe-91fd-1cd5d92a1e4e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:29.214318 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-104e3124-c041-4ffe-91fd-1cd5d92a1e4e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:29.214901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-104e3124-c041-4ffe-91fd-1cd5d92a1e4e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:29.440937 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-104e3124-c041-4ffe-91fd-1cd5d92a1e4e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:29.448557 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-104e3124-c041-4ffe-91fd-1cd5d92a1e4e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.251681 Oct 14 03:08:29.449126 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 76/146] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:29 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:29.458360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-5a1671b2-c792-4ae1-9d43-c2c1c782d97d req-41ab0d37-938e-4619-b248-4adb560a384c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f00fbd-d2ed-4c85-b341-8b02b1c2c20d", "name": "network-vif-plugged", "status": "completed", "tag": "26a9671e-04c8-470f-828a-9f6aa76bb214"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:29.467360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=100 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:29.469095 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-5a1671b2-c792-4ae1-9d43-c2c1c782d97d req-41ab0d37-938e-4619-b248-4adb560a384c service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:29.469732 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-5a1671b2-c792-4ae1-9d43-c2c1c782d97d req-41ab0d37-938e-4619-b248-4adb560a384c service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:29.470329 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-5a1671b2-c792-4ae1-9d43-c2c1c782d97d req-41ab0d37-938e-4619-b248-4adb560a384c service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:29.481976 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-5a1671b2-c792-4ae1-9d43-c2c1c782d97d req-41ab0d37-938e-4619-b248-4adb560a384c service nova] Creating event network-vif-plugged:26a9671e-04c8-470f-828a-9f6aa76bb214 for instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d on hv-cinder-80152 Oct 14 03:08:29.486729 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-5a1671b2-c792-4ae1-9d43-c2c1c782d97d req-41ab0d37-938e-4619-b248-4adb560a384c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033879 Oct 14 03:08:29.487329 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 77/147] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:29.551819 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-fdec547e-515a-4c02-8b27-c52eb48e12ef tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "POST /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.038476 Oct 14 03:08:29.553168 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 71/148] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Oct 14 03:08:26 2022] POST /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3/os-volume_attachments => generated 194 bytes in 3041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:29.926550 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5f935da9-dc9a-4d0e-9c9e-7889940fe323 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:29.927330 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5f935da9-dc9a-4d0e-9c9e-7889940fe323 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:29.935797 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5f935da9-dc9a-4d0e-9c9e-7889940fe323 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:29.936591 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5f935da9-dc9a-4d0e-9c9e-7889940fe323 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:29.937127 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5f935da9-dc9a-4d0e-9c9e-7889940fe323 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:29.938029 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5f935da9-dc9a-4d0e-9c9e-7889940fe323 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:29.938871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5f935da9-dc9a-4d0e-9c9e-7889940fe323 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:29.939543 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5f935da9-dc9a-4d0e-9c9e-7889940fe323 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:30.130615 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-5b5bd533-f320-4f21-bf9a-c61d6f53c1b5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:30.131984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-5b5bd533-f320-4f21-bf9a-c61d6f53c1b5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:30.141819 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5b5bd533-f320-4f21-bf9a-c61d6f53c1b5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:30.143619 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5b5bd533-f320-4f21-bf9a-c61d6f53c1b5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:30.144298 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5b5bd533-f320-4f21-bf9a-c61d6f53c1b5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:30.145116 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5b5bd533-f320-4f21-bf9a-c61d6f53c1b5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:30.145783 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5b5bd533-f320-4f21-bf9a-c61d6f53c1b5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:30.146437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5b5bd533-f320-4f21-bf9a-c61d6f53c1b5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:30.280383 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5f935da9-dc9a-4d0e-9c9e-7889940fe323 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:30.292023 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5f935da9-dc9a-4d0e-9c9e-7889940fe323 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:30.294871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5f935da9-dc9a-4d0e-9c9e-7889940fe323 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:30.296954 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5f935da9-dc9a-4d0e-9c9e-7889940fe323 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.376964 Oct 14 03:08:30.297778 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 78/149] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:29 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:30.353660 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5b5bd533-f320-4f21-bf9a-c61d6f53c1b5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:30.366426 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-5b5bd533-f320-4f21-bf9a-c61d6f53c1b5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.242516 Oct 14 03:08:30.367766 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 72/150] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:30 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:30.476937 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ff321569-46af-44be-88b6-a410cf8da5a3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:30.477551 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ff321569-46af-44be-88b6-a410cf8da5a3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:30.483376 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ff321569-46af-44be-88b6-a410cf8da5a3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:30.488952 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ff321569-46af-44be-88b6-a410cf8da5a3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:30.488952 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ff321569-46af-44be-88b6-a410cf8da5a3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:30.488952 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ff321569-46af-44be-88b6-a410cf8da5a3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:30.488952 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ff321569-46af-44be-88b6-a410cf8da5a3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:30.489260 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ff321569-46af-44be-88b6-a410cf8da5a3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:30.619924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ff321569-46af-44be-88b6-a410cf8da5a3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:30.628258 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ff321569-46af-44be-88b6-a410cf8da5a3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.155535 Oct 14 03:08:30.628867 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 79/151] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:30 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:31.322948 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-427a0006-affe-402f-99ea-ccfd6da7c1da tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:31.323467 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-427a0006-affe-402f-99ea-ccfd6da7c1da tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:31.330240 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-427a0006-affe-402f-99ea-ccfd6da7c1da tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.330700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-427a0006-affe-402f-99ea-ccfd6da7c1da tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.331164 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-427a0006-affe-402f-99ea-ccfd6da7c1da tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:31.331844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-427a0006-affe-402f-99ea-ccfd6da7c1da tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.332596 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-427a0006-affe-402f-99ea-ccfd6da7c1da tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.333015 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-427a0006-affe-402f-99ea-ccfd6da7c1da tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:31.394080 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-200d2bf0-5d95-4f75-b934-ef6dca9c49df tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:31.394696 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-200d2bf0-5d95-4f75-b934-ef6dca9c49df tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:31.405375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-200d2bf0-5d95-4f75-b934-ef6dca9c49df tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.405878 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-200d2bf0-5d95-4f75-b934-ef6dca9c49df tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.406323 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-200d2bf0-5d95-4f75-b934-ef6dca9c49df tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:31.407037 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-200d2bf0-5d95-4f75-b934-ef6dca9c49df tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.407498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-200d2bf0-5d95-4f75-b934-ef6dca9c49df tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.408527 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-200d2bf0-5d95-4f75-b934-ef6dca9c49df tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:31.547131 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-427a0006-affe-402f-99ea-ccfd6da7c1da tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:31.549719 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:31.557099 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-427a0006-affe-402f-99ea-ccfd6da7c1da tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:31.558702 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-427a0006-affe-402f-99ea-ccfd6da7c1da tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:31.560271 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-427a0006-affe-402f-99ea-ccfd6da7c1da tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1407 microversion: 2.20 time: 0.241320 Oct 14 03:08:31.564560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 73/152] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:31 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:31.593773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-200d2bf0-5d95-4f75-b934-ef6dca9c49df tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:31.600044 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-200d2bf0-5d95-4f75-b934-ef6dca9c49df tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.210288 Oct 14 03:08:31.600632 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 80/153] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:31 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:31.650916 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6d1c659a-374a-431b-9fbf-6a0a1235c0f5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:31.651863 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6d1c659a-374a-431b-9fbf-6a0a1235c0f5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:31.658668 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d1c659a-374a-431b-9fbf-6a0a1235c0f5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.659152 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d1c659a-374a-431b-9fbf-6a0a1235c0f5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.660099 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d1c659a-374a-431b-9fbf-6a0a1235c0f5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:31.660278 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d1c659a-374a-431b-9fbf-6a0a1235c0f5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.660763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d1c659a-374a-431b-9fbf-6a0a1235c0f5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.661191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d1c659a-374a-431b-9fbf-6a0a1235c0f5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:31.808941 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6d1c659a-374a-431b-9fbf-6a0a1235c0f5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:31.816959 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6d1c659a-374a-431b-9fbf-6a0a1235c0f5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.169874 Oct 14 03:08:31.817517 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 74/154] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:31 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:32.586354 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-488d2deb-8535-4ee7-b0e3-ed6d20529d47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:32.586966 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-488d2deb-8535-4ee7-b0e3-ed6d20529d47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:32.599390 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-488d2deb-8535-4ee7-b0e3-ed6d20529d47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:32.602760 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-488d2deb-8535-4ee7-b0e3-ed6d20529d47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:32.603961 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-488d2deb-8535-4ee7-b0e3-ed6d20529d47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:32.604956 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-488d2deb-8535-4ee7-b0e3-ed6d20529d47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:32.606253 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-488d2deb-8535-4ee7-b0e3-ed6d20529d47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:32.607686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-488d2deb-8535-4ee7-b0e3-ed6d20529d47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:32.624166 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9c1cdb5b-aa1d-4058-bf59-003923223848 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:32.625026 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9c1cdb5b-aa1d-4058-bf59-003923223848 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:32.635929 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9c1cdb5b-aa1d-4058-bf59-003923223848 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:32.636734 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9c1cdb5b-aa1d-4058-bf59-003923223848 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:32.637439 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9c1cdb5b-aa1d-4058-bf59-003923223848 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:32.638798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9c1cdb5b-aa1d-4058-bf59-003923223848 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:32.639893 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9c1cdb5b-aa1d-4058-bf59-003923223848 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:32.640333 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9c1cdb5b-aa1d-4058-bf59-003923223848 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:32.891820 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9c1cdb5b-aa1d-4058-bf59-003923223848 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:32.899649 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-488d2deb-8535-4ee7-b0e3-ed6d20529d47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:32.910849 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9c1cdb5b-aa1d-4058-bf59-003923223848 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.290741 Oct 14 03:08:32.913141 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-488d2deb-8535-4ee7-b0e3-ed6d20529d47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:32.914603 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-488d2deb-8535-4ee7-b0e3-ed6d20529d47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:32.915763 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-488d2deb-8535-4ee7-b0e3-ed6d20529d47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1598 microversion: 2.20 time: 0.334119 Oct 14 03:08:32.916329 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 81/155] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:32 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1598 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:32.917157 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 75/156] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:32 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:32.921850 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-46b6a464-fd94-4ce4-9b2e-a1b4673ad8a4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:32.922631 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-46b6a464-fd94-4ce4-9b2e-a1b4673ad8a4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:32.925815 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=100 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:32.929296 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46b6a464-fd94-4ce4-9b2e-a1b4673ad8a4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:32.929973 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46b6a464-fd94-4ce4-9b2e-a1b4673ad8a4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:32.930572 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46b6a464-fd94-4ce4-9b2e-a1b4673ad8a4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:32.931269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46b6a464-fd94-4ce4-9b2e-a1b4673ad8a4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:32.931732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46b6a464-fd94-4ce4-9b2e-a1b4673ad8a4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:32.932249 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46b6a464-fd94-4ce4-9b2e-a1b4673ad8a4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:32.943876 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8b57523a-e859-4a2c-a1c3-93625f2c1577 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:32.944374 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8b57523a-e859-4a2c-a1c3-93625f2c1577 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:32.959906 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b57523a-e859-4a2c-a1c3-93625f2c1577 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:32.960427 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b57523a-e859-4a2c-a1c3-93625f2c1577 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:32.960867 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b57523a-e859-4a2c-a1c3-93625f2c1577 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:32.961605 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b57523a-e859-4a2c-a1c3-93625f2c1577 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:32.962250 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b57523a-e859-4a2c-a1c3-93625f2c1577 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:32.962872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b57523a-e859-4a2c-a1c3-93625f2c1577 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:33.070423 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8b57523a-e859-4a2c-a1c3-93625f2c1577 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.130330 Oct 14 03:08:33.071121 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 82/157] 10.222.0.13 () {60 vars in 1316 bytes} [Fri Oct 14 03:08:32 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:08:33.117158 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-46b6a464-fd94-4ce4-9b2e-a1b4673ad8a4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:33.124842 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-46b6a464-fd94-4ce4-9b2e-a1b4673ad8a4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1368 microversion: 2.1 time: 0.206646 Oct 14 03:08:33.125677 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 76/158] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:32 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:33.939467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-6bdc7ead-9343-4d47-b2b8-98c246310c93 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:33.940118 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-6bdc7ead-9343-4d47-b2b8-98c246310c93 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:33.946708 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6bdc7ead-9343-4d47-b2b8-98c246310c93 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:33.947397 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6bdc7ead-9343-4d47-b2b8-98c246310c93 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:33.947996 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6bdc7ead-9343-4d47-b2b8-98c246310c93 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:33.948878 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6bdc7ead-9343-4d47-b2b8-98c246310c93 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:33.949485 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6bdc7ead-9343-4d47-b2b8-98c246310c93 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:33.952252 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6bdc7ead-9343-4d47-b2b8-98c246310c93 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:34.090652 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-6bdc7ead-9343-4d47-b2b8-98c246310c93 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:34.098670 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-6bdc7ead-9343-4d47-b2b8-98c246310c93 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.163579 Oct 14 03:08:34.099845 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 83/159] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:33 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:34.149551 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e168476b-0665-4039-ae12-1e77aaf45c94 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:34.151073 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e168476b-0665-4039-ae12-1e77aaf45c94 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:34.162622 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e168476b-0665-4039-ae12-1e77aaf45c94 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:34.163568 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e168476b-0665-4039-ae12-1e77aaf45c94 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:34.164312 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e168476b-0665-4039-ae12-1e77aaf45c94 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:34.165180 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e168476b-0665-4039-ae12-1e77aaf45c94 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:34.165842 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e168476b-0665-4039-ae12-1e77aaf45c94 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:34.166412 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e168476b-0665-4039-ae12-1e77aaf45c94 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:34.348550 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e168476b-0665-4039-ae12-1e77aaf45c94 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:34.357121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e168476b-0665-4039-ae12-1e77aaf45c94 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1558 microversion: 2.1 time: 0.212229 Oct 14 03:08:34.371150 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 77/160] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:34 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:34.381961 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-29097df0-da19-4216-bbe2-00bc9ef35e19 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:34.382837 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-29097df0-da19-4216-bbe2-00bc9ef35e19 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:34.389114 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-29097df0-da19-4216-bbe2-00bc9ef35e19 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:34.389699 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-29097df0-da19-4216-bbe2-00bc9ef35e19 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:34.390335 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-29097df0-da19-4216-bbe2-00bc9ef35e19 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:34.391134 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-29097df0-da19-4216-bbe2-00bc9ef35e19 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:34.395499 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-29097df0-da19-4216-bbe2-00bc9ef35e19 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:34.396152 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-29097df0-da19-4216-bbe2-00bc9ef35e19 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:34.481180 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-18f733bc-9610-4b0a-825e-2e882a5cb2a0 req-beed3326-d456-4e0e-8991-55780e042084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866d9750-81fa-4eba-a3b7-b1c1182ed24d", "tag": "846e0443-12a3-4f37-a28b-a559f43fd6b4"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:34.494389 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-18f733bc-9610-4b0a-825e-2e882a5cb2a0 req-beed3326-d456-4e0e-8991-55780e042084 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:34.495112 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-18f733bc-9610-4b0a-825e-2e882a5cb2a0 req-beed3326-d456-4e0e-8991-55780e042084 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:34.496207 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-18f733bc-9610-4b0a-825e-2e882a5cb2a0 req-beed3326-d456-4e0e-8991-55780e042084 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:34.510526 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-18f733bc-9610-4b0a-825e-2e882a5cb2a0 req-beed3326-d456-4e0e-8991-55780e042084 service nova] Creating event network-changed:846e0443-12a3-4f37-a28b-a559f43fd6b4 for instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d on hv-cinder-80152 Oct 14 03:08:34.513275 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-29097df0-da19-4216-bbe2-00bc9ef35e19 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135287 Oct 14 03:08:34.516371 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-18f733bc-9610-4b0a-825e-2e882a5cb2a0 req-beed3326-d456-4e0e-8991-55780e042084 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040501 Oct 14 03:08:34.520860 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 78/161] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:08:34.521793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 84/162] 10.222.0.13 () {58 vars in 1275 bytes} [Fri Oct 14 03:08:34 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:08:35.124785 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a1a57d50-bf9d-4cd1-94d3-462b604502aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:35.126036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-a1a57d50-bf9d-4cd1-94d3-462b604502aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:35.138818 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1a57d50-bf9d-4cd1-94d3-462b604502aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:35.140611 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1a57d50-bf9d-4cd1-94d3-462b604502aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:35.141063 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1a57d50-bf9d-4cd1-94d3-462b604502aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:35.142325 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1a57d50-bf9d-4cd1-94d3-462b604502aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:35.142804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1a57d50-bf9d-4cd1-94d3-462b604502aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:35.143295 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1a57d50-bf9d-4cd1-94d3-462b604502aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:35.218472 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c413e174-2b7f-4b2b-8985-02f531348dd3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:35.218969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c413e174-2b7f-4b2b-8985-02f531348dd3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:35.234651 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c413e174-2b7f-4b2b-8985-02f531348dd3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:35.238944 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c413e174-2b7f-4b2b-8985-02f531348dd3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:35.239541 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c413e174-2b7f-4b2b-8985-02f531348dd3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:35.240344 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c413e174-2b7f-4b2b-8985-02f531348dd3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:35.243219 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c413e174-2b7f-4b2b-8985-02f531348dd3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:35.243884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c413e174-2b7f-4b2b-8985-02f531348dd3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:35.332120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c413e174-2b7f-4b2b-8985-02f531348dd3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Going to try to terminate instance {{(pid=119301) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:08:35.335005 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a1a57d50-bf9d-4cd1-94d3-462b604502aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:35.348803 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-a1a57d50-bf9d-4cd1-94d3-462b604502aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.230654 Oct 14 03:08:35.363550 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 79/163] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:35 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:35.714852 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c413e174-2b7f-4b2b-8985-02f531348dd3 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "DELETE /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 204 len: 0 microversion: 2.1 time: 0.501000 Oct 14 03:08:35.715848 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 85/164] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:08:35 2022] DELETE /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:08:35.725172 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-7131ff8e-0c74-473b-a95c-84724a20ff59 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:35.725878 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-7131ff8e-0c74-473b-a95c-84724a20ff59 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:35.732253 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7131ff8e-0c74-473b-a95c-84724a20ff59 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:35.732984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7131ff8e-0c74-473b-a95c-84724a20ff59 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:35.733724 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7131ff8e-0c74-473b-a95c-84724a20ff59 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:35.734616 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7131ff8e-0c74-473b-a95c-84724a20ff59 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:35.735779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7131ff8e-0c74-473b-a95c-84724a20ff59 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:35.736665 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7131ff8e-0c74-473b-a95c-84724a20ff59 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:35.934882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7131ff8e-0c74-473b-a95c-84724a20ff59 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:35.949225 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-7131ff8e-0c74-473b-a95c-84724a20ff59 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1555 microversion: 2.1 time: 0.228550 Oct 14 03:08:35.950558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 80/165] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:35 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1555 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:36.373597 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a6ce4705-7ae9-4466-bf9b-16a16d25b2d1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:36.374842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a6ce4705-7ae9-4466-bf9b-16a16d25b2d1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:36.388534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a6ce4705-7ae9-4466-bf9b-16a16d25b2d1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:36.388534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a6ce4705-7ae9-4466-bf9b-16a16d25b2d1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:36.388534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a6ce4705-7ae9-4466-bf9b-16a16d25b2d1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:36.388534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a6ce4705-7ae9-4466-bf9b-16a16d25b2d1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:36.388826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a6ce4705-7ae9-4466-bf9b-16a16d25b2d1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:36.398681 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a6ce4705-7ae9-4466-bf9b-16a16d25b2d1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:36.534063 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-e2921bb6-c16f-4247-95f1-d5feb90f7989 req-42de5432-547c-4e08-8d83-ab476ef33fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f00fbd-d2ed-4c85-b341-8b02b1c2c20d", "tag": "26a9671e-04c8-470f-828a-9f6aa76bb214"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:36.552192 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-e2921bb6-c16f-4247-95f1-d5feb90f7989 req-42de5432-547c-4e08-8d83-ab476ef33fba service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:36.557447 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-e2921bb6-c16f-4247-95f1-d5feb90f7989 req-42de5432-547c-4e08-8d83-ab476ef33fba service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:36.558293 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-e2921bb6-c16f-4247-95f1-d5feb90f7989 req-42de5432-547c-4e08-8d83-ab476ef33fba service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:36.591874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-e2921bb6-c16f-4247-95f1-d5feb90f7989 req-42de5432-547c-4e08-8d83-ab476ef33fba service nova] Creating event network-changed:26a9671e-04c8-470f-828a-9f6aa76bb214 for instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d on hv-cinder-80152 Oct 14 03:08:36.601649 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-e2921bb6-c16f-4247-95f1-d5feb90f7989 req-42de5432-547c-4e08-8d83-ab476ef33fba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072607 Oct 14 03:08:36.602262 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 81/166] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:36.661927 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a6ce4705-7ae9-4466-bf9b-16a16d25b2d1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:36.677165 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a6ce4705-7ae9-4466-bf9b-16a16d25b2d1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.308156 Oct 14 03:08:36.677911 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 86/167] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:36 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:36.977195 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-7a2fac45-87bd-4686-9b6c-52a5a95abe20 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:36.978031 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-7a2fac45-87bd-4686-9b6c-52a5a95abe20 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:36.995663 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7a2fac45-87bd-4686-9b6c-52a5a95abe20 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:36.996159 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7a2fac45-87bd-4686-9b6c-52a5a95abe20 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:36.996631 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7a2fac45-87bd-4686-9b6c-52a5a95abe20 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:36.997340 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7a2fac45-87bd-4686-9b6c-52a5a95abe20 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:36.997801 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7a2fac45-87bd-4686-9b6c-52a5a95abe20 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:36.998232 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7a2fac45-87bd-4686-9b6c-52a5a95abe20 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:37.201354 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7a2fac45-87bd-4686-9b6c-52a5a95abe20 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:37.212858 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-7a2fac45-87bd-4686-9b6c-52a5a95abe20 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1555 microversion: 2.1 time: 0.242326 Oct 14 03:08:37.214239 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 82/168] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:36 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:37.699496 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-14dd6816-2ad4-4f3d-ae9b-1b2fcc04285f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:37.700988 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-14dd6816-2ad4-4f3d-ae9b-1b2fcc04285f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:37.703082 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=2 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:37.712430 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-14dd6816-2ad4-4f3d-ae9b-1b2fcc04285f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:37.713122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-14dd6816-2ad4-4f3d-ae9b-1b2fcc04285f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:37.716599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-14dd6816-2ad4-4f3d-ae9b-1b2fcc04285f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:37.716599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-14dd6816-2ad4-4f3d-ae9b-1b2fcc04285f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:37.716599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-14dd6816-2ad4-4f3d-ae9b-1b2fcc04285f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:37.716599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-14dd6816-2ad4-4f3d-ae9b-1b2fcc04285f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:37.901622 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-14dd6816-2ad4-4f3d-ae9b-1b2fcc04285f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:37.915148 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-14dd6816-2ad4-4f3d-ae9b-1b2fcc04285f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.219743 Oct 14 03:08:37.916091 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 87/169] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:37 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:38.240922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b560ac6f-c96d-41f9-a4c2-b2415d22f243 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:38.242125 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b560ac6f-c96d-41f9-a4c2-b2415d22f243 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:38.250379 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b560ac6f-c96d-41f9-a4c2-b2415d22f243 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:38.250840 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b560ac6f-c96d-41f9-a4c2-b2415d22f243 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:38.251583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b560ac6f-c96d-41f9-a4c2-b2415d22f243 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:38.252496 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b560ac6f-c96d-41f9-a4c2-b2415d22f243 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:38.253102 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b560ac6f-c96d-41f9-a4c2-b2415d22f243 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:38.253678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b560ac6f-c96d-41f9-a4c2-b2415d22f243 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:38.457661 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b560ac6f-c96d-41f9-a4c2-b2415d22f243 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:38.471151 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b560ac6f-c96d-41f9-a4c2-b2415d22f243 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1555 microversion: 2.1 time: 0.239827 Oct 14 03:08:38.472284 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 83/170] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:38 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1555 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:38.938992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-eaceb4a5-e041-4841-9d7e-c7b3c97d049c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:38.940292 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-eaceb4a5-e041-4841-9d7e-c7b3c97d049c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:38.947216 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eaceb4a5-e041-4841-9d7e-c7b3c97d049c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:38.947851 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eaceb4a5-e041-4841-9d7e-c7b3c97d049c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:38.948381 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eaceb4a5-e041-4841-9d7e-c7b3c97d049c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:38.949214 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eaceb4a5-e041-4841-9d7e-c7b3c97d049c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:38.949776 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eaceb4a5-e041-4841-9d7e-c7b3c97d049c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:38.950295 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eaceb4a5-e041-4841-9d7e-c7b3c97d049c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:38.976720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:39.134472 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-eaceb4a5-e041-4841-9d7e-c7b3c97d049c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:39.156483 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-eaceb4a5-e041-4841-9d7e-c7b3c97d049c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.220328 Oct 14 03:08:39.169343 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 88/171] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:38 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:39.495298 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b05d5fc5-9c1a-4c4e-8117-d7992201b536 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:39.496520 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b05d5fc5-9c1a-4c4e-8117-d7992201b536 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:39.505308 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b05d5fc5-9c1a-4c4e-8117-d7992201b536 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:39.506030 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b05d5fc5-9c1a-4c4e-8117-d7992201b536 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:39.506609 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b05d5fc5-9c1a-4c4e-8117-d7992201b536 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:39.507700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b05d5fc5-9c1a-4c4e-8117-d7992201b536 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:39.508295 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b05d5fc5-9c1a-4c4e-8117-d7992201b536 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:39.510474 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b05d5fc5-9c1a-4c4e-8117-d7992201b536 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:39.709986 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b05d5fc5-9c1a-4c4e-8117-d7992201b536 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:39.719677 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b05d5fc5-9c1a-4c4e-8117-d7992201b536 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1555 microversion: 2.1 time: 0.228366 Oct 14 03:08:39.720956 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 84/172] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:39 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1555 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:39.745098 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-2e1d2a3d-c188-40fd-9b7b-327ed13d0856 req-db67c460-ef22-431e-8493-ab409e03f6bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07aa0f1c-fa6a-478f-8b84-cf8124621ab3", "name": "network-vif-deleted", "tag": "716fa502-e091-4124-9f6f-e98fb49bb739"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:39.757994 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-2e1d2a3d-c188-40fd-9b7b-327ed13d0856 req-db67c460-ef22-431e-8493-ab409e03f6bb service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:39.758701 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-2e1d2a3d-c188-40fd-9b7b-327ed13d0856 req-db67c460-ef22-431e-8493-ab409e03f6bb service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:39.759137 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-2e1d2a3d-c188-40fd-9b7b-327ed13d0856 req-db67c460-ef22-431e-8493-ab409e03f6bb service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:39.770635 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-2e1d2a3d-c188-40fd-9b7b-327ed13d0856 req-db67c460-ef22-431e-8493-ab409e03f6bb service nova] Creating event network-vif-deleted:716fa502-e091-4124-9f6f-e98fb49bb739 for instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 on hv-cinder-80152 Oct 14 03:08:39.775893 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-2e1d2a3d-c188-40fd-9b7b-327ed13d0856 req-db67c460-ef22-431e-8493-ab409e03f6bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037530 Oct 14 03:08:39.776529 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 89/173] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:40.179854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-93dcf5aa-f545-4a2b-b296-d4f742ed2106 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:40.180262 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-93dcf5aa-f545-4a2b-b296-d4f742ed2106 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:40.189105 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-93dcf5aa-f545-4a2b-b296-d4f742ed2106 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:40.189560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-93dcf5aa-f545-4a2b-b296-d4f742ed2106 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:40.190265 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-93dcf5aa-f545-4a2b-b296-d4f742ed2106 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:40.190975 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-93dcf5aa-f545-4a2b-b296-d4f742ed2106 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:40.191436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-93dcf5aa-f545-4a2b-b296-d4f742ed2106 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:40.191991 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-93dcf5aa-f545-4a2b-b296-d4f742ed2106 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:40.341856 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-93dcf5aa-f545-4a2b-b296-d4f742ed2106 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:40.355794 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-93dcf5aa-f545-4a2b-b296-d4f742ed2106 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.179852 Oct 14 03:08:40.356427 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 85/174] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:40 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:40.745959 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f01e9d8a-ac36-43ed-a350-aa913c620240 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:40.746661 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f01e9d8a-ac36-43ed-a350-aa913c620240 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:40.757824 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f01e9d8a-ac36-43ed-a350-aa913c620240 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:40.758334 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f01e9d8a-ac36-43ed-a350-aa913c620240 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:40.758778 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f01e9d8a-ac36-43ed-a350-aa913c620240 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:40.759490 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f01e9d8a-ac36-43ed-a350-aa913c620240 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:40.760116 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f01e9d8a-ac36-43ed-a350-aa913c620240 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:40.760721 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f01e9d8a-ac36-43ed-a350-aa913c620240 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:40.831150 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f01e9d8a-ac36-43ed-a350-aa913c620240 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:40.845007 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f01e9d8a-ac36-43ed-a350-aa913c620240 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1346 microversion: 2.1 time: 0.104259 Oct 14 03:08:40.845674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 90/175] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:40 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:41.382608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-875aa95c-3c69-4b6c-8e1e-411ed231e9aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:41.383426 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-875aa95c-3c69-4b6c-8e1e-411ed231e9aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:41.395137 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-875aa95c-3c69-4b6c-8e1e-411ed231e9aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:41.403126 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-875aa95c-3c69-4b6c-8e1e-411ed231e9aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:41.403284 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-875aa95c-3c69-4b6c-8e1e-411ed231e9aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:41.404205 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-875aa95c-3c69-4b6c-8e1e-411ed231e9aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:41.404688 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-875aa95c-3c69-4b6c-8e1e-411ed231e9aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:41.405111 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-875aa95c-3c69-4b6c-8e1e-411ed231e9aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:41.540751 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-875aa95c-3c69-4b6c-8e1e-411ed231e9aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:41.549020 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-875aa95c-3c69-4b6c-8e1e-411ed231e9aa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.171490 Oct 14 03:08:41.549576 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 86/176] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:41 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:41.876586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c07e3a10-dac5-4004-a69b-0e090c9d1318 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:41.876586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c07e3a10-dac5-4004-a69b-0e090c9d1318 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:41.879406 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c07e3a10-dac5-4004-a69b-0e090c9d1318 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:41.879976 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c07e3a10-dac5-4004-a69b-0e090c9d1318 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:41.880710 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c07e3a10-dac5-4004-a69b-0e090c9d1318 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:41.881410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c07e3a10-dac5-4004-a69b-0e090c9d1318 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:41.881873 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c07e3a10-dac5-4004-a69b-0e090c9d1318 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:41.882410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c07e3a10-dac5-4004-a69b-0e090c9d1318 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:41.933977 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c07e3a10-dac5-4004-a69b-0e090c9d1318 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:41.933977 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c07e3a10-dac5-4004-a69b-0e090c9d1318 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:41.933977 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c07e3a10-dac5-4004-a69b-0e090c9d1318 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:41.934456 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-c07e3a10-dac5-4004-a69b-0e090c9d1318 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lazy-loading 'fault' on Instance uuid 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:08:41.984023 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c07e3a10-dac5-4004-a69b-0e090c9d1318 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc19ded49a74261b48bbe7c2a7f1904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6e8512548449958d68927e75882932', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:41.992355 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c07e3a10-dac5-4004-a69b-0e090c9d1318 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 200 len: 1351 microversion: 2.1 time: 0.125133 Oct 14 03:08:41.994559 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 91/177] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:41 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:42.571130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8fd7c60a-0502-4f04-9e98-377adada03a0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:42.571742 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8fd7c60a-0502-4f04-9e98-377adada03a0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:42.578057 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8fd7c60a-0502-4f04-9e98-377adada03a0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:42.578540 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8fd7c60a-0502-4f04-9e98-377adada03a0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:42.579002 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8fd7c60a-0502-4f04-9e98-377adada03a0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:42.579696 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8fd7c60a-0502-4f04-9e98-377adada03a0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:42.580149 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8fd7c60a-0502-4f04-9e98-377adada03a0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:42.580608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8fd7c60a-0502-4f04-9e98-377adada03a0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:42.716243 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8fd7c60a-0502-4f04-9e98-377adada03a0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:42.724190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8fd7c60a-0502-4f04-9e98-377adada03a0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.156852 Oct 14 03:08:42.724827 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 87/178] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:42 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:43.019726 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e9e7902f-91df-4b1a-aa42-8ee31a08a328 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:43.021064 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e9e7902f-91df-4b1a-aa42-8ee31a08a328 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:43.026795 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e9e7902f-91df-4b1a-aa42-8ee31a08a328 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:43.027568 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e9e7902f-91df-4b1a-aa42-8ee31a08a328 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:43.028181 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e9e7902f-91df-4b1a-aa42-8ee31a08a328 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:43.029091 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e9e7902f-91df-4b1a-aa42-8ee31a08a328 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:43.029819 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e9e7902f-91df-4b1a-aa42-8ee31a08a328 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:43.030130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e9e7902f-91df-4b1a-aa42-8ee31a08a328 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:43.049962 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-e9e7902f-91df-4b1a-aa42-8ee31a08a328 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] HTTP exception thrown: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e9e7902f-91df-4b1a-aa42-8ee31a08a328 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Request method failure captured: Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 HTTP/1.1 Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNJ-J66IKdlXvBfbwtqsKhbeFZTEG2eH7ZXKZQhgVMrH0IxI4q8dZdT8NRCgu5PS5QD87J3H88pcqAyZMBfgPbcXu36e_BK2FwYhMhJH4_jbJq8aAByPiYuQm0hm0AsH_4uc03nc29sNyLe9gXozKXdiTXn9u91pV7j_lnx0Rc0LnVU Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 8b6e8512548449958d68927e75882932 Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-DeleteServersTestJSON-910863584 Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:08:43.054820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:08:43.056407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b6e8512548449958d68927e75882932"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b6e8512548449958d68927e75882932"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8b6e8512548449958d68927e75882932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8b6e8512548449958d68927e75882932"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:08:43.056407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-DeleteServersTestJSON-910863584 Oct 14 03:08:43.056407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 8b6e8512548449958d68927e75882932 Oct 14 03:08:43.056407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-DeleteServersTestJSON-910863584 Oct 14 03:08:43.056407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-DeleteServersTestJSON-910863584-project Oct 14 03:08:43.056407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:08:43.056407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:08:43.056407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: ffc19ded49a74261b48bbe7c2a7f1904 Oct 14 03:08:43.056407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-DeleteServersTestJSON-910863584-project Oct 14 03:08:43.056407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:08:43.056407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:43.056407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '07aa0f1c-fa6a-478f-8b84-cf8124621ab3'} Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:08:43.057367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:43.058901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:08:43.061185 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e9e7902f-91df-4b1a-aa42-8ee31a08a328 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Returning 404 to user: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:08:43.062332 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e9e7902f-91df-4b1a-aa42-8ee31a08a328 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 404 len: 111 microversion: 2.1 time: 0.047624 Oct 14 03:08:43.063245 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 92/179] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:43 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:08:43.586621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-bea6f5f9-cfd6-4400-9a3b-6a59acf2216f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:43.588783 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-bea6f5f9-cfd6-4400-9a3b-6a59acf2216f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:43.595410 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bea6f5f9-cfd6-4400-9a3b-6a59acf2216f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:43.595888 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bea6f5f9-cfd6-4400-9a3b-6a59acf2216f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:43.596328 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bea6f5f9-cfd6-4400-9a3b-6a59acf2216f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:43.597059 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bea6f5f9-cfd6-4400-9a3b-6a59acf2216f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:43.597509 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bea6f5f9-cfd6-4400-9a3b-6a59acf2216f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:43.597936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bea6f5f9-cfd6-4400-9a3b-6a59acf2216f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:43.611096 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-bea6f5f9-cfd6-4400-9a3b-6a59acf2216f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] HTTP exception thrown: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-bea6f5f9-cfd6-4400-9a3b-6a59acf2216f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Request method failure captured: Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3/os-volume_attachments HTTP/1.1 Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNJ-J66IKdlXvBfbwtqsKhbeFZTEG2eH7ZXKZQhgVMrH0IxI4q8dZdT8NRCgu5PS5QD87J3H88pcqAyZMBfgPbcXu36e_BK2FwYhMhJH4_jbJq8aAByPiYuQm0hm0AsH_4uc03nc29sNyLe9gXozKXdiTXn9u91pV7j_lnx0Rc0LnVU Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 8b6e8512548449958d68927e75882932 Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-DeleteServersTestJSON-910863584 Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:08:43.616471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:08:43.617902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b6e8512548449958d68927e75882932"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b6e8512548449958d68927e75882932"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8b6e8512548449958d68927e75882932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8b6e8512548449958d68927e75882932"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:08:43.617902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-DeleteServersTestJSON-910863584 Oct 14 03:08:43.617902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 8b6e8512548449958d68927e75882932 Oct 14 03:08:43.617902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-DeleteServersTestJSON-910863584 Oct 14 03:08:43.617902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-DeleteServersTestJSON-910863584-project Oct 14 03:08:43.617902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:08:43.617902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:08:43.617902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: ffc19ded49a74261b48bbe7c2a7f1904 Oct 14 03:08:43.617902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-DeleteServersTestJSON-910863584-project Oct 14 03:08:43.617902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:08:43.617902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:43.617902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'server_id': '07aa0f1c-fa6a-478f-8b84-cf8124621ab3'} Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:08:43.618732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:43.620067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:08:43.621405 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-bea6f5f9-cfd6-4400-9a3b-6a59acf2216f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Returning 404 to user: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:08:43.621405 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-bea6f5f9-cfd6-4400-9a3b-6a59acf2216f tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035260 Oct 14 03:08:43.621405 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 88/180] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:08:43 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:08:43.747535 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f2b7fbb8-f317-4970-ad90-37e4a840cfdc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:43.748171 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f2b7fbb8-f317-4970-ad90-37e4a840cfdc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:43.754650 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2b7fbb8-f317-4970-ad90-37e4a840cfdc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:43.755130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2b7fbb8-f317-4970-ad90-37e4a840cfdc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:43.755558 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2b7fbb8-f317-4970-ad90-37e4a840cfdc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:43.756244 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2b7fbb8-f317-4970-ad90-37e4a840cfdc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:43.756889 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2b7fbb8-f317-4970-ad90-37e4a840cfdc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:43.757477 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2b7fbb8-f317-4970-ad90-37e4a840cfdc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:43.889153 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f2b7fbb8-f317-4970-ad90-37e4a840cfdc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:43.895549 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f2b7fbb8-f317-4970-ad90-37e4a840cfdc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.151777 Oct 14 03:08:43.896120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 93/181] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:43 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:44.920113 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c11739f9-dce5-499b-9047-5da64a63cefe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:44.921376 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c11739f9-dce5-499b-9047-5da64a63cefe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:44.936846 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c11739f9-dce5-499b-9047-5da64a63cefe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:44.937335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c11739f9-dce5-499b-9047-5da64a63cefe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:44.937874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c11739f9-dce5-499b-9047-5da64a63cefe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:44.938537 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c11739f9-dce5-499b-9047-5da64a63cefe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:44.939185 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c11739f9-dce5-499b-9047-5da64a63cefe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:44.939664 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c11739f9-dce5-499b-9047-5da64a63cefe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:45.055186 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-82e7c17d-d66a-4dd1-b1d4-16c14e17fae6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:45.055761 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-82e7c17d-d66a-4dd1-b1d4-16c14e17fae6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:45.062171 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-82e7c17d-d66a-4dd1-b1d4-16c14e17fae6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:45.062638 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-82e7c17d-d66a-4dd1-b1d4-16c14e17fae6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:45.063729 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-82e7c17d-d66a-4dd1-b1d4-16c14e17fae6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:45.066172 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-82e7c17d-d66a-4dd1-b1d4-16c14e17fae6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:45.066642 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-82e7c17d-d66a-4dd1-b1d4-16c14e17fae6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:45.069435 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-82e7c17d-d66a-4dd1-b1d4-16c14e17fae6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:45.083151 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c11739f9-dce5-499b-9047-5da64a63cefe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:45.083824 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-82e7c17d-d66a-4dd1-b1d4-16c14e17fae6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] HTTP exception thrown: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-82e7c17d-d66a-4dd1-b1d4-16c14e17fae6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Request method failure captured: Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: DELETE /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 HTTP/1.1 Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNJ-J66IKdlXvBfbwtqsKhbeFZTEG2eH7ZXKZQhgVMrH0IxI4q8dZdT8NRCgu5PS5QD87J3H88pcqAyZMBfgPbcXu36e_BK2FwYhMhJH4_jbJq8aAByPiYuQm0hm0AsH_4uc03nc29sNyLe9gXozKXdiTXn9u91pV7j_lnx0Rc0LnVU Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 8b6e8512548449958d68927e75882932 Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-DeleteServersTestJSON-910863584 Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:08:45.085581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:08:45.086969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b6e8512548449958d68927e75882932"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b6e8512548449958d68927e75882932"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8b6e8512548449958d68927e75882932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8b6e8512548449958d68927e75882932"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:08:45.086969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-DeleteServersTestJSON-910863584 Oct 14 03:08:45.086969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 8b6e8512548449958d68927e75882932 Oct 14 03:08:45.086969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-DeleteServersTestJSON-910863584 Oct 14 03:08:45.086969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-DeleteServersTestJSON-910863584-project Oct 14 03:08:45.086969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:08:45.086969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:08:45.086969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: ffc19ded49a74261b48bbe7c2a7f1904 Oct 14 03:08:45.086969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-DeleteServersTestJSON-910863584-project Oct 14 03:08:45.086969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:08:45.086969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:45.086969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '07aa0f1c-fa6a-478f-8b84-cf8124621ab3'} Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:08:45.087611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:45.088892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:08:45.090718 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-82e7c17d-d66a-4dd1-b1d4-16c14e17fae6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Returning 404 to user: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:08:45.091671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c11739f9-dce5-499b-9047-5da64a63cefe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.176873 Oct 14 03:08:45.091940 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-82e7c17d-d66a-4dd1-b1d4-16c14e17fae6 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "DELETE /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 404 len: 111 microversion: 2.1 time: 0.040682 Oct 14 03:08:45.093552 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 89/182] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:44 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:45.096552 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 94/183] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:08:45 2022] DELETE /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:08:45.104770 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-21dd092c-1cb8-4d08-ab80-9b72f885d208 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:45.105726 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-21dd092c-1cb8-4d08-ab80-9b72f885d208 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] [instance: 07aa0f1c-fa6a-478f-8b84-cf8124621ab3] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:45.112413 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-21dd092c-1cb8-4d08-ab80-9b72f885d208 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:45.113210 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-21dd092c-1cb8-4d08-ab80-9b72f885d208 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:45.113654 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-21dd092c-1cb8-4d08-ab80-9b72f885d208 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:45.114357 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-21dd092c-1cb8-4d08-ab80-9b72f885d208 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:45.114925 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-21dd092c-1cb8-4d08-ab80-9b72f885d208 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:45.115257 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-21dd092c-1cb8-4d08-ab80-9b72f885d208 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:45.129820 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-21dd092c-1cb8-4d08-ab80-9b72f885d208 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] HTTP exception thrown: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-21dd092c-1cb8-4d08-ab80-9b72f885d208 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Request method failure captured: Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 HTTP/1.1 Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNJ-J66IKdlXvBfbwtqsKhbeFZTEG2eH7ZXKZQhgVMrH0IxI4q8dZdT8NRCgu5PS5QD87J3H88pcqAyZMBfgPbcXu36e_BK2FwYhMhJH4_jbJq8aAByPiYuQm0hm0AsH_4uc03nc29sNyLe9gXozKXdiTXn9u91pV7j_lnx0Rc0LnVU Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 8b6e8512548449958d68927e75882932 Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-DeleteServersTestJSON-910863584 Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:08:45.131933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:08:45.133362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b6e8512548449958d68927e75882932"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b6e8512548449958d68927e75882932"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8b6e8512548449958d68927e75882932"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8b6e8512548449958d68927e75882932"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:08:45.133362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-DeleteServersTestJSON-910863584 Oct 14 03:08:45.133362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 8b6e8512548449958d68927e75882932 Oct 14 03:08:45.133362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-DeleteServersTestJSON-910863584 Oct 14 03:08:45.133362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-DeleteServersTestJSON-910863584-project Oct 14 03:08:45.133362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:08:45.133362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:08:45.133362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: ffc19ded49a74261b48bbe7c2a7f1904 Oct 14 03:08:45.133362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-DeleteServersTestJSON-910863584-project Oct 14 03:08:45.133362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:08:45.133362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:45.133362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': '07aa0f1c-fa6a-478f-8b84-cf8124621ab3'} Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:08:45.134162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. Oct 14 03:08:45.135440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:08:45.136656 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-21dd092c-1cb8-4d08-ab80-9b72f885d208 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] Returning 404 to user: Instance 07aa0f1c-fa6a-478f-8b84-cf8124621ab3 could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:08:45.136656 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-21dd092c-1cb8-4d08-ab80-9b72f885d208 tempest-DeleteServersTestJSON-910863584 tempest-DeleteServersTestJSON-910863584-project] 10.222.0.13 "GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3" status: 404 len: 111 microversion: 2.1 time: 0.033157 Oct 14 03:08:45.136656 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 90/184] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:45 2022] GET /compute/v2.1/servers/07aa0f1c-fa6a-478f-8b84-cf8124621ab3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:08:46.118659 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b24165a1-f17f-4e1d-87f3-a8043dd47587 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:46.119358 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b24165a1-f17f-4e1d-87f3-a8043dd47587 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:46.125973 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b24165a1-f17f-4e1d-87f3-a8043dd47587 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:46.128126 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b24165a1-f17f-4e1d-87f3-a8043dd47587 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:46.128126 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b24165a1-f17f-4e1d-87f3-a8043dd47587 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:46.128126 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b24165a1-f17f-4e1d-87f3-a8043dd47587 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:46.128126 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b24165a1-f17f-4e1d-87f3-a8043dd47587 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:46.128566 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b24165a1-f17f-4e1d-87f3-a8043dd47587 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:46.343649 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b24165a1-f17f-4e1d-87f3-a8043dd47587 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:46.353199 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b24165a1-f17f-4e1d-87f3-a8043dd47587 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.238444 Oct 14 03:08:46.356555 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 95/185] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:46 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:47.379539 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-46e754f4-0f79-4f00-bb98-392b3656a8a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:47.384646 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-46e754f4-0f79-4f00-bb98-392b3656a8a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:47.387276 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46e754f4-0f79-4f00-bb98-392b3656a8a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:47.393077 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46e754f4-0f79-4f00-bb98-392b3656a8a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:47.397711 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46e754f4-0f79-4f00-bb98-392b3656a8a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:47.398772 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46e754f4-0f79-4f00-bb98-392b3656a8a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:47.403060 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46e754f4-0f79-4f00-bb98-392b3656a8a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:47.403759 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46e754f4-0f79-4f00-bb98-392b3656a8a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:47.668697 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-46e754f4-0f79-4f00-bb98-392b3656a8a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:47.679749 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-46e754f4-0f79-4f00-bb98-392b3656a8a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.304499 Oct 14 03:08:47.696614 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 91/186] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:47 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:48.704149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-405e5f04-8848-4147-a4e2-c173777a4f64 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:48.705573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-405e5f04-8848-4147-a4e2-c173777a4f64 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:48.715167 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-405e5f04-8848-4147-a4e2-c173777a4f64 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:48.719620 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-405e5f04-8848-4147-a4e2-c173777a4f64 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:48.721732 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-405e5f04-8848-4147-a4e2-c173777a4f64 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:48.723246 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-405e5f04-8848-4147-a4e2-c173777a4f64 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:48.725962 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-405e5f04-8848-4147-a4e2-c173777a4f64 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:48.726586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-405e5f04-8848-4147-a4e2-c173777a4f64 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:48.978336 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-405e5f04-8848-4147-a4e2-c173777a4f64 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:48.986581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-405e5f04-8848-4147-a4e2-c173777a4f64 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.287275 Oct 14 03:08:48.987807 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 96/187] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:48 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:50.010779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-91d55797-3a39-4262-885b-1a7074afe027 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:50.011314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-91d55797-3a39-4262-885b-1a7074afe027 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:50.018799 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-91d55797-3a39-4262-885b-1a7074afe027 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:50.019293 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-91d55797-3a39-4262-885b-1a7074afe027 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:50.019832 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-91d55797-3a39-4262-885b-1a7074afe027 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:50.020524 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-91d55797-3a39-4262-885b-1a7074afe027 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:50.020983 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-91d55797-3a39-4262-885b-1a7074afe027 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:50.021412 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-91d55797-3a39-4262-885b-1a7074afe027 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:50.153840 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-91d55797-3a39-4262-885b-1a7074afe027 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:50.162412 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-91d55797-3a39-4262-885b-1a7074afe027 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.155803 Oct 14 03:08:50.162994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 92/188] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:50 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:51.186365 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e1c791e2-e7c0-41e4-a629-289c420ee408 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:51.186365 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e1c791e2-e7c0-41e4-a629-289c420ee408 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:51.191608 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e1c791e2-e7c0-41e4-a629-289c420ee408 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:51.192089 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e1c791e2-e7c0-41e4-a629-289c420ee408 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:51.192552 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e1c791e2-e7c0-41e4-a629-289c420ee408 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:51.193487 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e1c791e2-e7c0-41e4-a629-289c420ee408 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:51.193937 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e1c791e2-e7c0-41e4-a629-289c420ee408 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:51.194359 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e1c791e2-e7c0-41e4-a629-289c420ee408 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:51.344654 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-e1c791e2-e7c0-41e4-a629-289c420ee408 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:51.352677 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e1c791e2-e7c0-41e4-a629-289c420ee408 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.172061 Oct 14 03:08:51.353562 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 97/189] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:51 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:52.376204 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-7cfdbb82-ab51-4f49-87fb-fa36d1e63a80 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:52.377609 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-7cfdbb82-ab51-4f49-87fb-fa36d1e63a80 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:52.383455 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7cfdbb82-ab51-4f49-87fb-fa36d1e63a80 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:52.383942 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7cfdbb82-ab51-4f49-87fb-fa36d1e63a80 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:52.384377 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7cfdbb82-ab51-4f49-87fb-fa36d1e63a80 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:52.385104 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7cfdbb82-ab51-4f49-87fb-fa36d1e63a80 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:52.385554 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7cfdbb82-ab51-4f49-87fb-fa36d1e63a80 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:52.386185 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7cfdbb82-ab51-4f49-87fb-fa36d1e63a80 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:52.390933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=100 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:52.532043 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7cfdbb82-ab51-4f49-87fb-fa36d1e63a80 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:52.539888 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-7cfdbb82-ab51-4f49-87fb-fa36d1e63a80 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.168276 Oct 14 03:08:52.540475 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 93/190] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:52 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:53.569675 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a616fe4d-be5f-4008-91f4-53275348e484 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:53.570527 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a616fe4d-be5f-4008-91f4-53275348e484 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:53.576412 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a616fe4d-be5f-4008-91f4-53275348e484 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:53.576953 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a616fe4d-be5f-4008-91f4-53275348e484 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:53.577388 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a616fe4d-be5f-4008-91f4-53275348e484 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:53.578827 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a616fe4d-be5f-4008-91f4-53275348e484 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:53.579270 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a616fe4d-be5f-4008-91f4-53275348e484 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:53.580065 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a616fe4d-be5f-4008-91f4-53275348e484 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:53.767696 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a616fe4d-be5f-4008-91f4-53275348e484 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:53.775978 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a616fe4d-be5f-4008-91f4-53275348e484 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.210149 Oct 14 03:08:53.776839 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 98/191] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:53 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:54.811275 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e0bdee34-86f1-4442-a1ee-177c33b726fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:54.811275 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e0bdee34-86f1-4442-a1ee-177c33b726fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:54.811275 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0bdee34-86f1-4442-a1ee-177c33b726fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:54.811275 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0bdee34-86f1-4442-a1ee-177c33b726fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:54.811943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0bdee34-86f1-4442-a1ee-177c33b726fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:54.811943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0bdee34-86f1-4442-a1ee-177c33b726fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:54.811943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0bdee34-86f1-4442-a1ee-177c33b726fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:54.811943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0bdee34-86f1-4442-a1ee-177c33b726fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:54.946514 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e0bdee34-86f1-4442-a1ee-177c33b726fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:54.954407 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e0bdee34-86f1-4442-a1ee-177c33b726fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.159054 Oct 14 03:08:54.954981 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 94/192] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:54 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:55.977839 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d79a852e-a045-4d3c-9d80-e3222066cc42 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:55.978441 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d79a852e-a045-4d3c-9d80-e3222066cc42 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:55.992564 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d79a852e-a045-4d3c-9d80-e3222066cc42 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:55.993058 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d79a852e-a045-4d3c-9d80-e3222066cc42 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:55.993695 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d79a852e-a045-4d3c-9d80-e3222066cc42 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:55.994396 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d79a852e-a045-4d3c-9d80-e3222066cc42 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:55.994993 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d79a852e-a045-4d3c-9d80-e3222066cc42 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:55.995420 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d79a852e-a045-4d3c-9d80-e3222066cc42 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:56.133311 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d79a852e-a045-4d3c-9d80-e3222066cc42 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:56.142114 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d79a852e-a045-4d3c-9d80-e3222066cc42 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.168067 Oct 14 03:08:56.142868 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 99/193] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:55 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:57.166247 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-61222db6-dbcd-4e55-986b-97a72a660d20 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:57.166858 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-61222db6-dbcd-4e55-986b-97a72a660d20 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:57.172864 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-61222db6-dbcd-4e55-986b-97a72a660d20 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:57.173348 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-61222db6-dbcd-4e55-986b-97a72a660d20 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:57.173782 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-61222db6-dbcd-4e55-986b-97a72a660d20 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:57.174468 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-61222db6-dbcd-4e55-986b-97a72a660d20 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:57.174923 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-61222db6-dbcd-4e55-986b-97a72a660d20 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:57.175354 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-61222db6-dbcd-4e55-986b-97a72a660d20 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:57.325377 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-61222db6-dbcd-4e55-986b-97a72a660d20 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:57.334086 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-61222db6-dbcd-4e55-986b-97a72a660d20 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.171706 Oct 14 03:08:57.334903 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 95/194] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:57 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:58.357653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3d79abba-3a22-4c77-b026-7d083264ac85 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:58.359082 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3d79abba-3a22-4c77-b026-7d083264ac85 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:58.369180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3d79abba-3a22-4c77-b026-7d083264ac85 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:58.369180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3d79abba-3a22-4c77-b026-7d083264ac85 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:58.369180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3d79abba-3a22-4c77-b026-7d083264ac85 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:58.369180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3d79abba-3a22-4c77-b026-7d083264ac85 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:58.369853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3d79abba-3a22-4c77-b026-7d083264ac85 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:58.370567 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3d79abba-3a22-4c77-b026-7d083264ac85 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:58.555241 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3d79abba-3a22-4c77-b026-7d083264ac85 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:58.563816 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3d79abba-3a22-4c77-b026-7d083264ac85 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.210601 Oct 14 03:08:58.577046 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 100/195] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:58 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:59.588680 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3cf5738e-f5d9-4f7d-9322-beb2d81fc42c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:59.589838 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-3cf5738e-f5d9-4f7d-9322-beb2d81fc42c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:59.615402 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3cf5738e-f5d9-4f7d-9322-beb2d81fc42c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:59.616276 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3cf5738e-f5d9-4f7d-9322-beb2d81fc42c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:59.616914 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3cf5738e-f5d9-4f7d-9322-beb2d81fc42c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:59.617789 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3cf5738e-f5d9-4f7d-9322-beb2d81fc42c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:59.618403 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3cf5738e-f5d9-4f7d-9322-beb2d81fc42c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:59.618970 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3cf5738e-f5d9-4f7d-9322-beb2d81fc42c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:59.930315 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3cf5738e-f5d9-4f7d-9322-beb2d81fc42c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:59.939354 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-3cf5738e-f5d9-4f7d-9322-beb2d81fc42c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.354386 Oct 14 03:08:59.939979 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 96/196] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:59 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:00.964270 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-79515fdf-92c3-4afc-9a28-32a1126c1a65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:00.964969 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-79515fdf-92c3-4afc-9a28-32a1126c1a65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:00.972865 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:00.975246 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-79515fdf-92c3-4afc-9a28-32a1126c1a65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:00.978586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-79515fdf-92c3-4afc-9a28-32a1126c1a65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:00.978586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-79515fdf-92c3-4afc-9a28-32a1126c1a65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:00.978586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-79515fdf-92c3-4afc-9a28-32a1126c1a65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:00.978586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-79515fdf-92c3-4afc-9a28-32a1126c1a65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:00.978978 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-79515fdf-92c3-4afc-9a28-32a1126c1a65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:01.159782 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-79515fdf-92c3-4afc-9a28-32a1126c1a65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:01.178419 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-79515fdf-92c3-4afc-9a28-32a1126c1a65 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.217891 Oct 14 03:09:01.179767 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 101/197] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:00 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:02.205145 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f880dc6e-b845-433d-8e64-ffc73fb7dc5f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:02.207196 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f880dc6e-b845-433d-8e64-ffc73fb7dc5f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:02.214399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f880dc6e-b845-433d-8e64-ffc73fb7dc5f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:02.214893 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f880dc6e-b845-433d-8e64-ffc73fb7dc5f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:02.215358 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f880dc6e-b845-433d-8e64-ffc73fb7dc5f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:02.216283 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f880dc6e-b845-433d-8e64-ffc73fb7dc5f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:02.216828 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f880dc6e-b845-433d-8e64-ffc73fb7dc5f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:02.217252 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f880dc6e-b845-433d-8e64-ffc73fb7dc5f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:02.383923 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-f880dc6e-b845-433d-8e64-ffc73fb7dc5f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:02.393051 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f880dc6e-b845-433d-8e64-ffc73fb7dc5f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.193737 Oct 14 03:09:02.394170 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 97/198] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:02 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:03.416687 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5a01fc57-5cba-4453-a017-a95344e470f2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:03.417308 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5a01fc57-5cba-4453-a017-a95344e470f2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:03.424335 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5a01fc57-5cba-4453-a017-a95344e470f2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:03.424854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5a01fc57-5cba-4453-a017-a95344e470f2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:03.425288 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5a01fc57-5cba-4453-a017-a95344e470f2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:03.425976 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5a01fc57-5cba-4453-a017-a95344e470f2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:03.426425 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5a01fc57-5cba-4453-a017-a95344e470f2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:03.426845 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5a01fc57-5cba-4453-a017-a95344e470f2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:03.617623 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5a01fc57-5cba-4453-a017-a95344e470f2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:03.630493 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5a01fc57-5cba-4453-a017-a95344e470f2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.217911 Oct 14 03:09:03.631178 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 102/199] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:03 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:04.654839 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8faf5fff-48b9-40e2-8da0-00264ece4c9a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:04.657167 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8faf5fff-48b9-40e2-8da0-00264ece4c9a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:04.660184 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=43 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:04.665449 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8faf5fff-48b9-40e2-8da0-00264ece4c9a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:04.666745 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8faf5fff-48b9-40e2-8da0-00264ece4c9a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:04.667359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8faf5fff-48b9-40e2-8da0-00264ece4c9a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:04.668248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8faf5fff-48b9-40e2-8da0-00264ece4c9a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:04.669282 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8faf5fff-48b9-40e2-8da0-00264ece4c9a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:04.669894 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8faf5fff-48b9-40e2-8da0-00264ece4c9a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:04.816711 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8faf5fff-48b9-40e2-8da0-00264ece4c9a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:04.826437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8faf5fff-48b9-40e2-8da0-00264ece4c9a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.175680 Oct 14 03:09:04.827564 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 98/200] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:04 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:05.850831 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9f83191a-ae8a-4b92-aa3c-34a6558cdc25 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:05.851594 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-9f83191a-ae8a-4b92-aa3c-34a6558cdc25 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:05.860294 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9f83191a-ae8a-4b92-aa3c-34a6558cdc25 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:05.860920 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9f83191a-ae8a-4b92-aa3c-34a6558cdc25 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:05.861626 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9f83191a-ae8a-4b92-aa3c-34a6558cdc25 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:05.864224 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9f83191a-ae8a-4b92-aa3c-34a6558cdc25 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:05.864773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9f83191a-ae8a-4b92-aa3c-34a6558cdc25 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:05.867558 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9f83191a-ae8a-4b92-aa3c-34a6558cdc25 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:06.068232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-9f83191a-ae8a-4b92-aa3c-34a6558cdc25 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:06.085399 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9f83191a-ae8a-4b92-aa3c-34a6558cdc25 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.238053 Oct 14 03:09:06.086739 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 103/201] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:05 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:06.861176 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-577613467", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "networks": [{"uuid": "51c44ef9-ad29-42ed-8d34-ac50ddef9948"}]}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:06.922334 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.network.neutron [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] validate_networks() for [('51c44ef9-ad29-42ed-8d34-ac50ddef9948', None, None, None, None, None)] {{(pid=119302) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:09:07.110996 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-09a0c42d-2f01-468b-83a6-9b7756b9f20e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:07.111602 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-09a0c42d-2f01-468b-83a6-9b7756b9f20e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:07.117825 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09a0c42d-2f01-468b-83a6-9b7756b9f20e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:07.118307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09a0c42d-2f01-468b-83a6-9b7756b9f20e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:07.118737 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09a0c42d-2f01-468b-83a6-9b7756b9f20e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:07.119433 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09a0c42d-2f01-468b-83a6-9b7756b9f20e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:07.119879 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09a0c42d-2f01-468b-83a6-9b7756b9f20e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:07.120300 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09a0c42d-2f01-468b-83a6-9b7756b9f20e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:07.329658 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-09a0c42d-2f01-468b-83a6-9b7756b9f20e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:07.342019 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-09a0c42d-2f01-468b-83a6-9b7756b9f20e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1520 microversion: 2.1 time: 0.234848 Oct 14 03:09:07.342698 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 104/202] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:07 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:07.373586 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Flavor limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:09:07.374752 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Image limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:09:07.375289 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Flavor pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:09:07.375661 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Image pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:09:07.376061 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:09:07.385141 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:07.385625 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:07.386060 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:07.386788 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:07.387238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:07.387660 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:07.403672 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Getting quotas for project 2672469044ae418186a01036e653f609. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:09:07.408099 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Getting quotas for user 73ae4a16f6004c1ba3ac3ee19def9399 and project 2672469044ae418186a01036e653f609. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:09:07.420218 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Going to run 1 instances... {{(pid=119302) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:09:07.423146 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:09:07.682551 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-1b23c3f9-7fc5-400c-a77b-2596002da7a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944887 Oct 14 03:09:07.683286 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 99/203] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:09:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 14 03:09:07.696199 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-05c86ff6-af15-498f-b65a-9b1b947ec261 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:07.697167 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-05c86ff6-af15-498f-b65a-9b1b947ec261 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:07.755333 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-05c86ff6-af15-498f-b65a-9b1b947ec261 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:07.762560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-05c86ff6-af15-498f-b65a-9b1b947ec261 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1213 microversion: 2.1 time: 0.070438 Oct 14 03:09:07.763143 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 105/204] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:07 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:08.365503 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2807869b-a9d1-4530-abf1-359e2cebe059 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:08.366119 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2807869b-a9d1-4530-abf1-359e2cebe059 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:08.372653 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2807869b-a9d1-4530-abf1-359e2cebe059 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:08.373138 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2807869b-a9d1-4530-abf1-359e2cebe059 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:08.374082 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2807869b-a9d1-4530-abf1-359e2cebe059 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:08.374772 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2807869b-a9d1-4530-abf1-359e2cebe059 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:08.375236 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2807869b-a9d1-4530-abf1-359e2cebe059 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:08.375667 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2807869b-a9d1-4530-abf1-359e2cebe059 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:08.508536 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2807869b-a9d1-4530-abf1-359e2cebe059 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:08.516854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2807869b-a9d1-4530-abf1-359e2cebe059 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1500 microversion: 2.1 time: 0.155525 Oct 14 03:09:08.518059 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 100/205] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:08 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:08.540214 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8e7b4911-a5a6-45a3-ab4f-ac24805c37a4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:08.540941 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8e7b4911-a5a6-45a3-ab4f-ac24805c37a4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:08.546671 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8e7b4911-a5a6-45a3-ab4f-ac24805c37a4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:08.547185 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8e7b4911-a5a6-45a3-ab4f-ac24805c37a4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:08.547624 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8e7b4911-a5a6-45a3-ab4f-ac24805c37a4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:08.548313 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8e7b4911-a5a6-45a3-ab4f-ac24805c37a4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:08.548794 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8e7b4911-a5a6-45a3-ab4f-ac24805c37a4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:08.549211 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8e7b4911-a5a6-45a3-ab4f-ac24805c37a4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:08.690825 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8e7b4911-a5a6-45a3-ab4f-ac24805c37a4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:08.698659 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8e7b4911-a5a6-45a3-ab4f-ac24805c37a4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1515 microversion: 2.1 time: 0.162225 Oct 14 03:09:08.699231 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 106/206] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:08 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:08.785289 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-71599e82-525f-42b7-a208-35fe8cc16f88 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:08.785911 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-71599e82-525f-42b7-a208-35fe8cc16f88 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:08.840143 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-71599e82-525f-42b7-a208-35fe8cc16f88 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:08.852999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-71599e82-525f-42b7-a208-35fe8cc16f88 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1213 microversion: 2.1 time: 0.067108 Oct 14 03:09:08.853774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 101/207] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:08 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:09.876160 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-43bc9e46-76fb-469a-ae44-80d979460cad tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:09.876850 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-43bc9e46-76fb-469a-ae44-80d979460cad tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:09.882891 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-43bc9e46-76fb-469a-ae44-80d979460cad tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:09.883380 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-43bc9e46-76fb-469a-ae44-80d979460cad tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:09.883816 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-43bc9e46-76fb-469a-ae44-80d979460cad tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:09.884547 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-43bc9e46-76fb-469a-ae44-80d979460cad tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:09.885003 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-43bc9e46-76fb-469a-ae44-80d979460cad tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:09.885431 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-43bc9e46-76fb-469a-ae44-80d979460cad tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:09.949320 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-43bc9e46-76fb-469a-ae44-80d979460cad tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:09.953582 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=100 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:09.958723 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-43bc9e46-76fb-469a-ae44-80d979460cad tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1265 microversion: 2.1 time: 0.086885 Oct 14 03:09:09.961144 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 107/208] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:09 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:10.486153 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-1de8cd2d-830b-4215-908a-cf8ae0014f86 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:10.490294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-1de8cd2d-830b-4215-908a-cf8ae0014f86 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:10.498691 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1de8cd2d-830b-4215-908a-cf8ae0014f86 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:10.499296 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1de8cd2d-830b-4215-908a-cf8ae0014f86 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:10.500618 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1de8cd2d-830b-4215-908a-cf8ae0014f86 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:10.502092 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1de8cd2d-830b-4215-908a-cf8ae0014f86 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:10.502873 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1de8cd2d-830b-4215-908a-cf8ae0014f86 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:10.503309 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1de8cd2d-830b-4215-908a-cf8ae0014f86 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:10.526188 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-1de8cd2d-830b-4215-908a-cf8ae0014f86 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lazy-loading 'flavor' on Instance uuid d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:09:10.892516 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-1de8cd2d-830b-4215-908a-cf8ae0014f86 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "POST /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7/action" status: 200 len: 32 microversion: 2.1 time: 0.411008 Oct 14 03:09:10.893275 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 102/209] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Oct 14 03:09:10 2022] POST /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7/action => generated 32 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:09:10.902890 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-82c44155-1b7d-437c-a337-dd19b126754a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:10.903507 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-82c44155-1b7d-437c-a337-dd19b126754a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:10.926686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-82c44155-1b7d-437c-a337-dd19b126754a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:10.928902 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-82c44155-1b7d-437c-a337-dd19b126754a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:10.932514 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-82c44155-1b7d-437c-a337-dd19b126754a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:10.932514 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-82c44155-1b7d-437c-a337-dd19b126754a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:10.932514 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-82c44155-1b7d-437c-a337-dd19b126754a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:10.932514 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-82c44155-1b7d-437c-a337-dd19b126754a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:10.985672 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-fe7430cf-522e-45dc-b99a-782623d24b61 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:10.987014 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-fe7430cf-522e-45dc-b99a-782623d24b61 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:11.004774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe7430cf-522e-45dc-b99a-782623d24b61 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:11.006037 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe7430cf-522e-45dc-b99a-782623d24b61 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:11.007888 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe7430cf-522e-45dc-b99a-782623d24b61 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:11.009036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe7430cf-522e-45dc-b99a-782623d24b61 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:11.012865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe7430cf-522e-45dc-b99a-782623d24b61 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:11.012865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe7430cf-522e-45dc-b99a-782623d24b61 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:11.136954 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-fe7430cf-522e-45dc-b99a-782623d24b61 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:11.153798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-fe7430cf-522e-45dc-b99a-782623d24b61 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1271 microversion: 2.1 time: 0.175112 Oct 14 03:09:11.154397 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 103/210] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:10 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:11.162636 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-82c44155-1b7d-437c-a337-dd19b126754a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:11.177674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-82c44155-1b7d-437c-a337-dd19b126754a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.278610 Oct 14 03:09:11.178367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 108/211] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:10 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:12.206874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-81f6df16-b140-4e79-a83c-3a73099c78a2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:12.206874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-81f6df16-b140-4e79-a83c-3a73099c78a2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:12.206874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-81f6df16-b140-4e79-a83c-3a73099c78a2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:12.206874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-81f6df16-b140-4e79-a83c-3a73099c78a2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:12.207942 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-81f6df16-b140-4e79-a83c-3a73099c78a2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:12.207942 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-81f6df16-b140-4e79-a83c-3a73099c78a2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:12.207942 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-81f6df16-b140-4e79-a83c-3a73099c78a2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:12.207942 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-81f6df16-b140-4e79-a83c-3a73099c78a2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:12.208265 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a5f402ef-a2ac-42c7-9156-50d85e816750 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:12.208265 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a5f402ef-a2ac-42c7-9156-50d85e816750 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:12.210524 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a5f402ef-a2ac-42c7-9156-50d85e816750 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:12.211007 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a5f402ef-a2ac-42c7-9156-50d85e816750 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:12.211440 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a5f402ef-a2ac-42c7-9156-50d85e816750 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:12.212448 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a5f402ef-a2ac-42c7-9156-50d85e816750 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:12.212950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a5f402ef-a2ac-42c7-9156-50d85e816750 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:12.213332 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a5f402ef-a2ac-42c7-9156-50d85e816750 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:12.403692 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-81f6df16-b140-4e79-a83c-3a73099c78a2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:12.408671 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a5f402ef-a2ac-42c7-9156-50d85e816750 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:12.414487 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-81f6df16-b140-4e79-a83c-3a73099c78a2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1313 microversion: 2.1 time: 0.238840 Oct 14 03:09:12.418586 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 104/212] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:12 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:12.418704 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a5f402ef-a2ac-42c7-9156-50d85e816750 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.219888 Oct 14 03:09:12.418704 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 109/213] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:12 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:12.747927 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-c0ca7e02-120c-4ff8-8710-b16795d925e6 req-b699bcae-2f4b-4ed7-8bd3-891359eaec4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "821d8281-460e-4bd2-acf4-ad27ebfc3bbd", "tag": "f5138f0b-dec0-40fb-9b23-fce833327056"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:12.758155 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-c0ca7e02-120c-4ff8-8710-b16795d925e6 req-b699bcae-2f4b-4ed7-8bd3-891359eaec4e service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:12.762463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-c0ca7e02-120c-4ff8-8710-b16795d925e6 req-b699bcae-2f4b-4ed7-8bd3-891359eaec4e service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:12.762463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-c0ca7e02-120c-4ff8-8710-b16795d925e6 req-b699bcae-2f4b-4ed7-8bd3-891359eaec4e service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:12.772930 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-c0ca7e02-120c-4ff8-8710-b16795d925e6 req-b699bcae-2f4b-4ed7-8bd3-891359eaec4e service nova] Creating event network-changed:f5138f0b-dec0-40fb-9b23-fce833327056 for instance 821d8281-460e-4bd2-acf4-ad27ebfc3bbd on hv-cinder-80152 Oct 14 03:09:12.786508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-c0ca7e02-120c-4ff8-8710-b16795d925e6 req-b699bcae-2f4b-4ed7-8bd3-891359eaec4e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046242 Oct 14 03:09:12.791183 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 105/214] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:13.441556 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ebc2ef1d-9d12-4d5c-b30e-2d18fc84446e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:13.442220 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-2f74217e-a52b-4a3b-a59e-7e330d5f5f5a tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:13.443274 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-2f74217e-a52b-4a3b-a59e-7e330d5f5f5a tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:13.443612 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ebc2ef1d-9d12-4d5c-b30e-2d18fc84446e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:13.450556 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ebc2ef1d-9d12-4d5c-b30e-2d18fc84446e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:13.451458 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ebc2ef1d-9d12-4d5c-b30e-2d18fc84446e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:13.452064 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ebc2ef1d-9d12-4d5c-b30e-2d18fc84446e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:13.452871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f74217e-a52b-4a3b-a59e-7e330d5f5f5a tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:13.453183 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ebc2ef1d-9d12-4d5c-b30e-2d18fc84446e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:13.453554 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f74217e-a52b-4a3b-a59e-7e330d5f5f5a tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:13.453949 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ebc2ef1d-9d12-4d5c-b30e-2d18fc84446e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:13.454462 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f74217e-a52b-4a3b-a59e-7e330d5f5f5a tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:13.454701 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ebc2ef1d-9d12-4d5c-b30e-2d18fc84446e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:13.455955 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f74217e-a52b-4a3b-a59e-7e330d5f5f5a tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:13.456624 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f74217e-a52b-4a3b-a59e-7e330d5f5f5a tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:13.457872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f74217e-a52b-4a3b-a59e-7e330d5f5f5a tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:13.717726 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ebc2ef1d-9d12-4d5c-b30e-2d18fc84446e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:13.727010 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ebc2ef1d-9d12-4d5c-b30e-2d18fc84446e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.290246 Oct 14 03:09:13.727722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 106/215] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:13 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:13.737990 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-2f74217e-a52b-4a3b-a59e-7e330d5f5f5a tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:13.747632 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-2f74217e-a52b-4a3b-a59e-7e330d5f5f5a tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1313 microversion: 2.1 time: 0.311366 Oct 14 03:09:13.747632 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 110/216] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:13 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:14.751262 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8ed61b40-7f30-45cb-98e1-5c3ee498011c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:14.751889 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8ed61b40-7f30-45cb-98e1-5c3ee498011c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:14.759148 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8ed61b40-7f30-45cb-98e1-5c3ee498011c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:14.759633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8ed61b40-7f30-45cb-98e1-5c3ee498011c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:14.760219 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8ed61b40-7f30-45cb-98e1-5c3ee498011c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:14.761684 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8ed61b40-7f30-45cb-98e1-5c3ee498011c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:14.762405 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8ed61b40-7f30-45cb-98e1-5c3ee498011c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:14.764319 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8ed61b40-7f30-45cb-98e1-5c3ee498011c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:14.769862 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-75e87048-0b7f-48e1-8eb2-35665bd68ac2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:14.770579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-75e87048-0b7f-48e1-8eb2-35665bd68ac2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:14.776962 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-75e87048-0b7f-48e1-8eb2-35665bd68ac2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:14.777751 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-75e87048-0b7f-48e1-8eb2-35665bd68ac2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:14.778129 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-75e87048-0b7f-48e1-8eb2-35665bd68ac2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:14.779042 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-75e87048-0b7f-48e1-8eb2-35665bd68ac2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:14.779567 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-75e87048-0b7f-48e1-8eb2-35665bd68ac2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:14.780043 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-75e87048-0b7f-48e1-8eb2-35665bd68ac2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:14.967394 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8ed61b40-7f30-45cb-98e1-5c3ee498011c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:14.979122 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8ed61b40-7f30-45cb-98e1-5c3ee498011c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.232252 Oct 14 03:09:14.979706 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 107/217] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:14 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:14.982541 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-75e87048-0b7f-48e1-8eb2-35665bd68ac2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:14.992314 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-75e87048-0b7f-48e1-8eb2-35665bd68ac2 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1313 microversion: 2.1 time: 0.226669 Oct 14 03:09:15.006036 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 111/218] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:14 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:16.003341 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0d54cf31-751d-4c6e-968a-58d382f83d01 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:16.004039 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-0d54cf31-751d-4c6e-968a-58d382f83d01 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:16.012076 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0d54cf31-751d-4c6e-968a-58d382f83d01 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:16.012642 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0d54cf31-751d-4c6e-968a-58d382f83d01 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:16.013162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0d54cf31-751d-4c6e-968a-58d382f83d01 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:16.013874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0d54cf31-751d-4c6e-968a-58d382f83d01 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:16.014329 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0d54cf31-751d-4c6e-968a-58d382f83d01 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:16.014748 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0d54cf31-751d-4c6e-968a-58d382f83d01 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:16.016866 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-302b4401-e522-40ca-90d0-a189ebcb74fa tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:16.018585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-302b4401-e522-40ca-90d0-a189ebcb74fa tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:16.025293 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-302b4401-e522-40ca-90d0-a189ebcb74fa tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:16.025787 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-302b4401-e522-40ca-90d0-a189ebcb74fa tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:16.026406 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-302b4401-e522-40ca-90d0-a189ebcb74fa tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:16.027262 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-302b4401-e522-40ca-90d0-a189ebcb74fa tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:16.027728 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-302b4401-e522-40ca-90d0-a189ebcb74fa tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:16.028158 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-302b4401-e522-40ca-90d0-a189ebcb74fa tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:16.215285 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-0d54cf31-751d-4c6e-968a-58d382f83d01 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:16.223441 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-0d54cf31-751d-4c6e-968a-58d382f83d01 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.224544 Oct 14 03:09:16.224992 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 108/219] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:15 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:16.230484 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-302b4401-e522-40ca-90d0-a189ebcb74fa tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:16.240741 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-302b4401-e522-40ca-90d0-a189ebcb74fa tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1313 microversion: 2.1 time: 0.228728 Oct 14 03:09:16.252785 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 112/220] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:16 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:17.246909 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-558d083c-487f-4c61-a924-af04d0a59e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:17.247525 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-558d083c-487f-4c61-a924-af04d0a59e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:17.254342 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-558d083c-487f-4c61-a924-af04d0a59e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:17.254823 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-558d083c-487f-4c61-a924-af04d0a59e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:17.255261 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-558d083c-487f-4c61-a924-af04d0a59e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:17.255956 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-558d083c-487f-4c61-a924-af04d0a59e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:17.256428 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-558d083c-487f-4c61-a924-af04d0a59e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:17.256853 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-558d083c-487f-4c61-a924-af04d0a59e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:17.265877 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-891962e2-bba6-43b5-9f7a-84db65f5f041 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:17.266482 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-891962e2-bba6-43b5-9f7a-84db65f5f041 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:17.273102 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-891962e2-bba6-43b5-9f7a-84db65f5f041 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:17.273800 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-891962e2-bba6-43b5-9f7a-84db65f5f041 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:17.274230 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-891962e2-bba6-43b5-9f7a-84db65f5f041 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:17.275208 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-891962e2-bba6-43b5-9f7a-84db65f5f041 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:17.275661 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-891962e2-bba6-43b5-9f7a-84db65f5f041 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:17.276080 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-891962e2-bba6-43b5-9f7a-84db65f5f041 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:17.400055 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=2 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:17.453389 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-558d083c-487f-4c61-a924-af04d0a59e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:17.462579 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-558d083c-487f-4c61-a924-af04d0a59e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.219474 Oct 14 03:09:17.463160 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 109/221] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:17 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:17.467828 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-891962e2-bba6-43b5-9f7a-84db65f5f041 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:17.475686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-891962e2-bba6-43b5-9f7a-84db65f5f041 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1313 microversion: 2.1 time: 0.213543 Oct 14 03:09:17.480742 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 113/222] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:17 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:18.486375 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-1cd7b996-ce69-4f6b-b2b8-3327294e9af5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:18.486919 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-1cd7b996-ce69-4f6b-b2b8-3327294e9af5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:18.493788 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1cd7b996-ce69-4f6b-b2b8-3327294e9af5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:18.494273 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1cd7b996-ce69-4f6b-b2b8-3327294e9af5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:18.494715 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1cd7b996-ce69-4f6b-b2b8-3327294e9af5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:18.495410 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1cd7b996-ce69-4f6b-b2b8-3327294e9af5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:18.495868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1cd7b996-ce69-4f6b-b2b8-3327294e9af5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:18.496324 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1cd7b996-ce69-4f6b-b2b8-3327294e9af5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:18.497793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-154dfdd1-97b3-4dfd-aa93-3caec20f9f5b tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:18.498414 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-154dfdd1-97b3-4dfd-aa93-3caec20f9f5b tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:18.499235 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:18.500274 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=2 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:18.505544 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-154dfdd1-97b3-4dfd-aa93-3caec20f9f5b tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:18.506097 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-154dfdd1-97b3-4dfd-aa93-3caec20f9f5b tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:18.509208 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-154dfdd1-97b3-4dfd-aa93-3caec20f9f5b tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:18.509208 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-154dfdd1-97b3-4dfd-aa93-3caec20f9f5b tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:18.509208 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-154dfdd1-97b3-4dfd-aa93-3caec20f9f5b tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:18.509208 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-154dfdd1-97b3-4dfd-aa93-3caec20f9f5b tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:18.711406 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1cd7b996-ce69-4f6b-b2b8-3327294e9af5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:18.716248 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-154dfdd1-97b3-4dfd-aa93-3caec20f9f5b tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:18.719558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-1cd7b996-ce69-4f6b-b2b8-3327294e9af5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.237330 Oct 14 03:09:18.720926 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 110/223] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:18 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:18.724870 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-154dfdd1-97b3-4dfd-aa93-3caec20f9f5b tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1313 microversion: 2.1 time: 0.230812 Oct 14 03:09:18.727263 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 114/224] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:18 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:19.747886 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-37eb7d95-82a3-4921-a3b1-5e5f2789c2ab tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:19.748568 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0e88ade4-ae1c-4ada-88dc-0d45ebb4b91c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:19.748933 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-37eb7d95-82a3-4921-a3b1-5e5f2789c2ab tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:19.749026 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-0e88ade4-ae1c-4ada-88dc-0d45ebb4b91c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:19.752270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=8 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:19.754788 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37eb7d95-82a3-4921-a3b1-5e5f2789c2ab tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:19.754946 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37eb7d95-82a3-4921-a3b1-5e5f2789c2ab tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:19.755391 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37eb7d95-82a3-4921-a3b1-5e5f2789c2ab tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:19.756093 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37eb7d95-82a3-4921-a3b1-5e5f2789c2ab tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:19.756657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37eb7d95-82a3-4921-a3b1-5e5f2789c2ab tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:19.756987 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37eb7d95-82a3-4921-a3b1-5e5f2789c2ab tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:19.758044 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0e88ade4-ae1c-4ada-88dc-0d45ebb4b91c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:19.759686 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0e88ade4-ae1c-4ada-88dc-0d45ebb4b91c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:19.759686 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0e88ade4-ae1c-4ada-88dc-0d45ebb4b91c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:19.759686 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0e88ade4-ae1c-4ada-88dc-0d45ebb4b91c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:19.760268 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0e88ade4-ae1c-4ada-88dc-0d45ebb4b91c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:19.760588 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0e88ade4-ae1c-4ada-88dc-0d45ebb4b91c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:19.953754 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-37eb7d95-82a3-4921-a3b1-5e5f2789c2ab tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:19.958883 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-0e88ade4-ae1c-4ada-88dc-0d45ebb4b91c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:19.963481 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-37eb7d95-82a3-4921-a3b1-5e5f2789c2ab tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1313 microversion: 2.1 time: 0.219332 Oct 14 03:09:19.964069 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 115/225] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:19 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:19.966763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-0e88ade4-ae1c-4ada-88dc-0d45ebb4b91c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.222700 Oct 14 03:09:19.967525 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 111/226] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:19 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:20.444088 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-086dc2c8-aff2-4b7e-87f9-d52a70311647 req-a15292e3-a1d1-4c75-ab30-4ef5986a9261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821d8281-460e-4bd2-acf4-ad27ebfc3bbd", "name": "network-vif-plugged", "status": "completed", "tag": "f5138f0b-dec0-40fb-9b23-fce833327056"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:20.453395 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-086dc2c8-aff2-4b7e-87f9-d52a70311647 req-a15292e3-a1d1-4c75-ab30-4ef5986a9261 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:20.453873 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-086dc2c8-aff2-4b7e-87f9-d52a70311647 req-a15292e3-a1d1-4c75-ab30-4ef5986a9261 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:20.454304 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-086dc2c8-aff2-4b7e-87f9-d52a70311647 req-a15292e3-a1d1-4c75-ab30-4ef5986a9261 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:20.465223 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-086dc2c8-aff2-4b7e-87f9-d52a70311647 req-a15292e3-a1d1-4c75-ab30-4ef5986a9261 service nova] Creating event network-vif-plugged:f5138f0b-dec0-40fb-9b23-fce833327056 for instance 821d8281-460e-4bd2-acf4-ad27ebfc3bbd on hv-cinder-80152 Oct 14 03:09:20.470209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-086dc2c8-aff2-4b7e-87f9-d52a70311647 req-a15292e3-a1d1-4c75-ab30-4ef5986a9261 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029767 Oct 14 03:09:20.470799 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 116/227] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:20.987167 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-95babfe2-f7f3-4259-8793-440ba804c0a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:20.987769 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-95babfe2-f7f3-4259-8793-440ba804c0a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:20.994377 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-af2e63c6-96f4-4850-9a61-91f41ed04022 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:20.994846 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-95babfe2-f7f3-4259-8793-440ba804c0a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:20.995067 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-af2e63c6-96f4-4850-9a61-91f41ed04022 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:20.995205 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-95babfe2-f7f3-4259-8793-440ba804c0a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:20.995595 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-95babfe2-f7f3-4259-8793-440ba804c0a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:20.996296 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-95babfe2-f7f3-4259-8793-440ba804c0a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:20.996786 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-95babfe2-f7f3-4259-8793-440ba804c0a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:20.997214 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-95babfe2-f7f3-4259-8793-440ba804c0a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:21.001210 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af2e63c6-96f4-4850-9a61-91f41ed04022 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:21.001690 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af2e63c6-96f4-4850-9a61-91f41ed04022 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:21.002122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af2e63c6-96f4-4850-9a61-91f41ed04022 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:21.002806 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af2e63c6-96f4-4850-9a61-91f41ed04022 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:21.003257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af2e63c6-96f4-4850-9a61-91f41ed04022 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:21.004462 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af2e63c6-96f4-4850-9a61-91f41ed04022 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:21.192623 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-95babfe2-f7f3-4259-8793-440ba804c0a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:21.201880 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-95babfe2-f7f3-4259-8793-440ba804c0a6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1313 microversion: 2.1 time: 0.218599 Oct 14 03:09:21.202627 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 112/228] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:20 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:21.218134 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-af2e63c6-96f4-4850-9a61-91f41ed04022 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:21.226421 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-af2e63c6-96f4-4850-9a61-91f41ed04022 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.236299 Oct 14 03:09:21.227650 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 117/229] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:20 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:22.225600 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e445487b-3729-4342-9632-cdaa59631aa3 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:22.226219 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e445487b-3729-4342-9632-cdaa59631aa3 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:22.232557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e445487b-3729-4342-9632-cdaa59631aa3 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:22.233048 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e445487b-3729-4342-9632-cdaa59631aa3 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:22.233485 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e445487b-3729-4342-9632-cdaa59631aa3 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:22.234175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e445487b-3729-4342-9632-cdaa59631aa3 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:22.234631 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e445487b-3729-4342-9632-cdaa59631aa3 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:22.235057 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e445487b-3729-4342-9632-cdaa59631aa3 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:22.250488 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-7cd88353-1097-4253-8f46-1b7266fd2928 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:22.251221 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-7cd88353-1097-4253-8f46-1b7266fd2928 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:22.260339 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7cd88353-1097-4253-8f46-1b7266fd2928 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:22.260339 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7cd88353-1097-4253-8f46-1b7266fd2928 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:22.260339 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7cd88353-1097-4253-8f46-1b7266fd2928 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:22.260339 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7cd88353-1097-4253-8f46-1b7266fd2928 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:22.260773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7cd88353-1097-4253-8f46-1b7266fd2928 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:22.260773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7cd88353-1097-4253-8f46-1b7266fd2928 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:22.443030 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e445487b-3729-4342-9632-cdaa59631aa3 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:22.447382 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-7cd88353-1097-4253-8f46-1b7266fd2928 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:22.451132 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e445487b-3729-4342-9632-cdaa59631aa3 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1313 microversion: 2.1 time: 0.229990 Oct 14 03:09:22.451710 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 113/230] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:22 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:22.455382 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-7cd88353-1097-4253-8f46-1b7266fd2928 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.208746 Oct 14 03:09:22.455938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 118/231] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:22 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:23.089396 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b8119a89-2441-4a85-bb11-c5f3edcc4c3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:23.089871 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b8119a89-2441-4a85-bb11-c5f3edcc4c3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:23.095769 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b8119a89-2441-4a85-bb11-c5f3edcc4c3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:23.096256 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b8119a89-2441-4a85-bb11-c5f3edcc4c3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:23.097601 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b8119a89-2441-4a85-bb11-c5f3edcc4c3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:23.097601 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b8119a89-2441-4a85-bb11-c5f3edcc4c3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:23.097990 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b8119a89-2441-4a85-bb11-c5f3edcc4c3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:23.098413 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b8119a89-2441-4a85-bb11-c5f3edcc4c3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:23.121624 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b8119a89-2441-4a85-bb11-c5f3edcc4c3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/ips" status: 200 len: 146 microversion: 2.1 time: 0.036202 Oct 14 03:09:23.122551 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 114/232] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Oct 14 03:09:23 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:23.475610 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-afad16fd-f599-4edc-a55c-f53aece0ed84 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:23.476314 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-afad16fd-f599-4edc-a55c-f53aece0ed84 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:23.477730 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-33eaeb82-3f51-4ec3-ae97-a2145d230ad0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:23.478659 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-33eaeb82-3f51-4ec3-ae97-a2145d230ad0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:23.482521 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-afad16fd-f599-4edc-a55c-f53aece0ed84 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:23.484588 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-afad16fd-f599-4edc-a55c-f53aece0ed84 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:23.484588 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-afad16fd-f599-4edc-a55c-f53aece0ed84 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:23.484588 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-afad16fd-f599-4edc-a55c-f53aece0ed84 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:23.484856 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-afad16fd-f599-4edc-a55c-f53aece0ed84 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:23.485094 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-afad16fd-f599-4edc-a55c-f53aece0ed84 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:23.487337 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-33eaeb82-3f51-4ec3-ae97-a2145d230ad0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:23.487952 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-33eaeb82-3f51-4ec3-ae97-a2145d230ad0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:23.488413 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-33eaeb82-3f51-4ec3-ae97-a2145d230ad0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:23.489646 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-33eaeb82-3f51-4ec3-ae97-a2145d230ad0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:23.490105 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-33eaeb82-3f51-4ec3-ae97-a2145d230ad0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:23.490616 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-33eaeb82-3f51-4ec3-ae97-a2145d230ad0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:23.870615 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-afad16fd-f599-4edc-a55c-f53aece0ed84 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:23.873547 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-33eaeb82-3f51-4ec3-ae97-a2145d230ad0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:23.878812 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-afad16fd-f599-4edc-a55c-f53aece0ed84 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1496 microversion: 2.1 time: 0.407870 Oct 14 03:09:23.879327 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 119/233] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:23 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1496 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:23.881362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-33eaeb82-3f51-4ec3-ae97-a2145d230ad0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.408106 Oct 14 03:09:23.881953 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 115/234] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:23 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:24.904180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-2fad4262-ccc6-49b4-8a75-bf03daa21fda tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:24.904843 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-2fad4262-ccc6-49b4-8a75-bf03daa21fda tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:24.911289 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2fad4262-ccc6-49b4-8a75-bf03daa21fda tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:24.912294 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2fad4262-ccc6-49b4-8a75-bf03daa21fda tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:24.912750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2fad4262-ccc6-49b4-8a75-bf03daa21fda tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:24.913444 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2fad4262-ccc6-49b4-8a75-bf03daa21fda tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:24.913895 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2fad4262-ccc6-49b4-8a75-bf03daa21fda tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:24.914316 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2fad4262-ccc6-49b4-8a75-bf03daa21fda tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:25.045531 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-2fad4262-ccc6-49b4-8a75-bf03daa21fda tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:25.054081 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-2fad4262-ccc6-49b4-8a75-bf03daa21fda tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.153850 Oct 14 03:09:25.054656 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 120/235] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:24 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:26.077239 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-56d4fe0b-f579-46b4-9662-fdaf05c42822 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:26.077851 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-56d4fe0b-f579-46b4-9662-fdaf05c42822 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:26.084418 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-56d4fe0b-f579-46b4-9662-fdaf05c42822 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:26.084928 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-56d4fe0b-f579-46b4-9662-fdaf05c42822 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:26.085336 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-56d4fe0b-f579-46b4-9662-fdaf05c42822 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:26.086025 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-56d4fe0b-f579-46b4-9662-fdaf05c42822 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:26.086481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-56d4fe0b-f579-46b4-9662-fdaf05c42822 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:26.086905 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-56d4fe0b-f579-46b4-9662-fdaf05c42822 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:26.219667 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-56d4fe0b-f579-46b4-9662-fdaf05c42822 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:26.228132 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-56d4fe0b-f579-46b4-9662-fdaf05c42822 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.154704 Oct 14 03:09:26.228902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 116/236] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:26 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:27.252851 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9fd78401-2e7a-4c2c-8643-0c2fd9369950 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:27.253546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-9fd78401-2e7a-4c2c-8643-0c2fd9369950 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:27.262114 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9fd78401-2e7a-4c2c-8643-0c2fd9369950 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:27.262114 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9fd78401-2e7a-4c2c-8643-0c2fd9369950 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:27.262409 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9fd78401-2e7a-4c2c-8643-0c2fd9369950 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:27.263236 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9fd78401-2e7a-4c2c-8643-0c2fd9369950 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:27.263724 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9fd78401-2e7a-4c2c-8643-0c2fd9369950 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:27.264145 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9fd78401-2e7a-4c2c-8643-0c2fd9369950 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:27.292727 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f6debaa7-bce1-4102-9648-d82988f52c28 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a24964a6-fd23-4163-9bce-96de5034508a"}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:27.295190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f6debaa7-bce1-4102-9648-d82988f52c28 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:27.312260 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f6debaa7-bce1-4102-9648-d82988f52c28 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:27.312798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f6debaa7-bce1-4102-9648-d82988f52c28 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:27.313231 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f6debaa7-bce1-4102-9648-d82988f52c28 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:27.313934 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f6debaa7-bce1-4102-9648-d82988f52c28 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:27.314395 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f6debaa7-bce1-4102-9648-d82988f52c28 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:27.314825 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f6debaa7-bce1-4102-9648-d82988f52c28 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:27.416583 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-9fd78401-2e7a-4c2c-8643-0c2fd9369950 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:27.446280 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9fd78401-2e7a-4c2c-8643-0c2fd9369950 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.183798 Oct 14 03:09:27.446280 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 121/237] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:27 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:28.102448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f6debaa7-bce1-4102-9648-d82988f52c28 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "POST /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.817231 Oct 14 03:09:28.103333 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 117/238] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Oct 14 03:09:27 2022] POST /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/os-volume_attachments => generated 194 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:28.212957 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f268df77-d2d4-41da-8d28-29bb4a546dc7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:28.213556 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f268df77-d2d4-41da-8d28-29bb4a546dc7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:28.219582 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f268df77-d2d4-41da-8d28-29bb4a546dc7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:28.220155 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f268df77-d2d4-41da-8d28-29bb4a546dc7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:28.220685 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f268df77-d2d4-41da-8d28-29bb4a546dc7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:28.221447 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f268df77-d2d4-41da-8d28-29bb4a546dc7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:28.222023 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f268df77-d2d4-41da-8d28-29bb4a546dc7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:28.222651 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f268df77-d2d4-41da-8d28-29bb4a546dc7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:28.247839 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f268df77-d2d4-41da-8d28-29bb4a546dc7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/ips" status: 200 len: 150 microversion: 2.20 time: 0.038799 Oct 14 03:09:28.248520 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 122/239] 10.222.0.13 () {60 vars in 1289 bytes} [Fri Oct 14 03:09:28 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:09:28.456307 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-7a159ce7-26da-4e4a-9d79-37b16b693dea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:28.457158 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-7a159ce7-26da-4e4a-9d79-37b16b693dea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:28.464160 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7a159ce7-26da-4e4a-9d79-37b16b693dea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:28.464449 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7a159ce7-26da-4e4a-9d79-37b16b693dea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:28.464930 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7a159ce7-26da-4e4a-9d79-37b16b693dea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:28.465653 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7a159ce7-26da-4e4a-9d79-37b16b693dea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:28.466106 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7a159ce7-26da-4e4a-9d79-37b16b693dea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:28.466548 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7a159ce7-26da-4e4a-9d79-37b16b693dea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:28.651798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7a159ce7-26da-4e4a-9d79-37b16b693dea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:28.660107 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-7a159ce7-26da-4e4a-9d79-37b16b693dea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.208422 Oct 14 03:09:28.660736 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 118/240] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:28 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:29.221372 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-93cc9cdb-42f6-450f-95eb-9ec8cecc6ec6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:29.221873 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-93cc9cdb-42f6-450f-95eb-9ec8cecc6ec6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:29.229062 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-93cc9cdb-42f6-450f-95eb-9ec8cecc6ec6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:29.229733 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-93cc9cdb-42f6-450f-95eb-9ec8cecc6ec6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:29.230176 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-93cc9cdb-42f6-450f-95eb-9ec8cecc6ec6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:29.230882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-93cc9cdb-42f6-450f-95eb-9ec8cecc6ec6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:29.231339 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-93cc9cdb-42f6-450f-95eb-9ec8cecc6ec6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:29.231764 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-93cc9cdb-42f6-450f-95eb-9ec8cecc6ec6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:29.257897 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-93cc9cdb-42f6-450f-95eb-9ec8cecc6ec6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Going to try to terminate instance {{(pid=119301) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:09:29.394299 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:29.621601 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-93cc9cdb-42f6-450f-95eb-9ec8cecc6ec6 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "DELETE /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 204 len: 0 microversion: 2.1 time: 0.403133 Oct 14 03:09:29.622120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 123/241] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:09:29 2022] DELETE /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:09:29.630284 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e855a171-2651-42cf-a441-9af8414daebf tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:29.630894 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e855a171-2651-42cf-a441-9af8414daebf tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:29.637434 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e855a171-2651-42cf-a441-9af8414daebf tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:29.637919 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e855a171-2651-42cf-a441-9af8414daebf tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:29.638352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e855a171-2651-42cf-a441-9af8414daebf tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:29.639044 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e855a171-2651-42cf-a441-9af8414daebf tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:29.639495 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e855a171-2651-42cf-a441-9af8414daebf tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:29.639921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e855a171-2651-42cf-a441-9af8414daebf tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:29.683614 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f25b7a2f-3d18-408e-9061-4a08768382d3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:29.684313 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f25b7a2f-3d18-408e-9061-4a08768382d3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:29.690840 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f25b7a2f-3d18-408e-9061-4a08768382d3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:29.691328 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f25b7a2f-3d18-408e-9061-4a08768382d3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:29.691767 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f25b7a2f-3d18-408e-9061-4a08768382d3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:29.692488 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f25b7a2f-3d18-408e-9061-4a08768382d3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:29.692944 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f25b7a2f-3d18-408e-9061-4a08768382d3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:29.693367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f25b7a2f-3d18-408e-9061-4a08768382d3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:29.859525 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e855a171-2651-42cf-a441-9af8414daebf tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:29.867658 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e855a171-2651-42cf-a441-9af8414daebf tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1502 microversion: 2.1 time: 0.241190 Oct 14 03:09:29.868234 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 119/242] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:29 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:29.880925 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f25b7a2f-3d18-408e-9061-4a08768382d3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:29.889334 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f25b7a2f-3d18-408e-9061-4a08768382d3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.210048 Oct 14 03:09:29.889905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 124/243] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:29 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:30.585602 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-7e1a4857-02b9-401a-818a-cc9dd46a2099 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:30.586088 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-7e1a4857-02b9-401a-818a-cc9dd46a2099 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:30.592442 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e1a4857-02b9-401a-818a-cc9dd46a2099 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:30.592940 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e1a4857-02b9-401a-818a-cc9dd46a2099 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:30.593384 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e1a4857-02b9-401a-818a-cc9dd46a2099 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:30.594086 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e1a4857-02b9-401a-818a-cc9dd46a2099 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:30.594548 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e1a4857-02b9-401a-818a-cc9dd46a2099 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:30.594980 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e1a4857-02b9-401a-818a-cc9dd46a2099 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:30.618468 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-7e1a4857-02b9-401a-818a-cc9dd46a2099 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d/ips" status: 200 len: 150 microversion: 2.1 time: 0.036730 Oct 14 03:09:30.619039 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 120/244] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Oct 14 03:09:30 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:09:30.693164 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a60aa67c-d583-4863-aa8c-6cdbe6ef059e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:30.694366 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a60aa67c-d583-4863-aa8c-6cdbe6ef059e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:30.701327 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a60aa67c-d583-4863-aa8c-6cdbe6ef059e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:30.701811 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a60aa67c-d583-4863-aa8c-6cdbe6ef059e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:30.702256 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a60aa67c-d583-4863-aa8c-6cdbe6ef059e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:30.702994 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a60aa67c-d583-4863-aa8c-6cdbe6ef059e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:30.703817 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a60aa67c-d583-4863-aa8c-6cdbe6ef059e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:30.704461 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a60aa67c-d583-4863-aa8c-6cdbe6ef059e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:30.727984 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-a60aa67c-d583-4863-aa8c-6cdbe6ef059e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lazy-loading 'flavor' on Instance uuid 866d9750-81fa-4eba-a3b7-b1c1182ed24d {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:09:30.892001 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-238f9a06-f97d-4b79-bbf1-0ffdf2f9db92 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:30.892638 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-238f9a06-f97d-4b79-bbf1-0ffdf2f9db92 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:30.899027 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-238f9a06-f97d-4b79-bbf1-0ffdf2f9db92 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:30.899501 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-238f9a06-f97d-4b79-bbf1-0ffdf2f9db92 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:30.899926 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-238f9a06-f97d-4b79-bbf1-0ffdf2f9db92 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:30.900638 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-238f9a06-f97d-4b79-bbf1-0ffdf2f9db92 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:30.901085 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-238f9a06-f97d-4b79-bbf1-0ffdf2f9db92 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:30.901511 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-238f9a06-f97d-4b79-bbf1-0ffdf2f9db92 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:31.044981 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-238f9a06-f97d-4b79-bbf1-0ffdf2f9db92 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:31.052926 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-238f9a06-f97d-4b79-bbf1-0ffdf2f9db92 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1502 microversion: 2.1 time: 0.165253 Oct 14 03:09:31.053510 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 121/245] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:30 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:31.058238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-06b0fe9b-9117-48ee-9a28-5476890abce5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:31.058842 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-06b0fe9b-9117-48ee-9a28-5476890abce5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:31.064742 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06b0fe9b-9117-48ee-9a28-5476890abce5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:31.065235 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06b0fe9b-9117-48ee-9a28-5476890abce5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:31.065673 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06b0fe9b-9117-48ee-9a28-5476890abce5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:31.066361 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06b0fe9b-9117-48ee-9a28-5476890abce5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:31.066815 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06b0fe9b-9117-48ee-9a28-5476890abce5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:31.067238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06b0fe9b-9117-48ee-9a28-5476890abce5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:31.214654 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-06b0fe9b-9117-48ee-9a28-5476890abce5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:31.222678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-06b0fe9b-9117-48ee-9a28-5476890abce5 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.167878 Oct 14 03:09:31.223245 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 122/246] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:31 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:31.295989 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a60aa67c-d583-4863-aa8c-6cdbe6ef059e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "POST /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/action" status: 202 len: 0 microversion: 2.20 time: 0.606669 Oct 14 03:09:31.296619 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 125/247] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Oct 14 03:09:30 2022] POST /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:09:31.309720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a3915096-c809-461c-99c1-a0b27aeffef1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:31.310359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-a3915096-c809-461c-99c1-a0b27aeffef1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:31.316275 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a3915096-c809-461c-99c1-a0b27aeffef1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:31.317090 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a3915096-c809-461c-99c1-a0b27aeffef1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:31.317682 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a3915096-c809-461c-99c1-a0b27aeffef1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:31.318541 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a3915096-c809-461c-99c1-a0b27aeffef1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:31.319014 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a3915096-c809-461c-99c1-a0b27aeffef1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:31.319453 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a3915096-c809-461c-99c1-a0b27aeffef1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:31.463525 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a3915096-c809-461c-99c1-a0b27aeffef1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:31.474088 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a3915096-c809-461c-99c1-a0b27aeffef1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:31.475852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a3915096-c809-461c-99c1-a0b27aeffef1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:31.477398 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-a3915096-c809-461c-99c1-a0b27aeffef1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.171538 Oct 14 03:09:31.491634 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 123/248] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:31 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:32.077117 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-aae49e61-f82d-4b72-bf56-35583d422d78 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:32.080810 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-aae49e61-f82d-4b72-bf56-35583d422d78 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:32.084507 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-aae49e61-f82d-4b72-bf56-35583d422d78 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:32.085138 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-aae49e61-f82d-4b72-bf56-35583d422d78 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:32.085644 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-aae49e61-f82d-4b72-bf56-35583d422d78 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:32.086433 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-aae49e61-f82d-4b72-bf56-35583d422d78 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:32.086949 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-aae49e61-f82d-4b72-bf56-35583d422d78 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:32.087433 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-aae49e61-f82d-4b72-bf56-35583d422d78 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:32.225078 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-aae49e61-f82d-4b72-bf56-35583d422d78 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:32.233983 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-aae49e61-f82d-4b72-bf56-35583d422d78 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1502 microversion: 2.1 time: 0.161268 Oct 14 03:09:32.234562 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 126/249] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:32 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:32.248560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-7b98bca3-0d94-492c-9dfa-dfc0101d0ec7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:32.249349 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-7b98bca3-0d94-492c-9dfa-dfc0101d0ec7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:32.256756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7b98bca3-0d94-492c-9dfa-dfc0101d0ec7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:32.257391 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7b98bca3-0d94-492c-9dfa-dfc0101d0ec7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:32.257832 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7b98bca3-0d94-492c-9dfa-dfc0101d0ec7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:32.258601 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7b98bca3-0d94-492c-9dfa-dfc0101d0ec7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:32.259081 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7b98bca3-0d94-492c-9dfa-dfc0101d0ec7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:32.259654 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7b98bca3-0d94-492c-9dfa-dfc0101d0ec7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:32.368578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-3a89439a-046a-4a85-9d39-d4822a6ef02c req-93da7b50-8620-4610-b3de-c21d25a073c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821d8281-460e-4bd2-acf4-ad27ebfc3bbd", "name": "network-vif-deleted", "tag": "f5138f0b-dec0-40fb-9b23-fce833327056"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:32.383561 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-3a89439a-046a-4a85-9d39-d4822a6ef02c req-93da7b50-8620-4610-b3de-c21d25a073c5 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:32.388961 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-3a89439a-046a-4a85-9d39-d4822a6ef02c req-93da7b50-8620-4610-b3de-c21d25a073c5 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:32.388961 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-3a89439a-046a-4a85-9d39-d4822a6ef02c req-93da7b50-8620-4610-b3de-c21d25a073c5 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:32.396442 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-3a89439a-046a-4a85-9d39-d4822a6ef02c req-93da7b50-8620-4610-b3de-c21d25a073c5 service nova] Creating event network-vif-deleted:f5138f0b-dec0-40fb-9b23-fce833327056 for instance 821d8281-460e-4bd2-acf4-ad27ebfc3bbd on hv-cinder-80152 Oct 14 03:09:32.402256 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-3a89439a-046a-4a85-9d39-d4822a6ef02c req-93da7b50-8620-4610-b3de-c21d25a073c5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038208 Oct 14 03:09:32.402854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 127/250] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:32.416130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7b98bca3-0d94-492c-9dfa-dfc0101d0ec7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:32.433984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-7b98bca3-0d94-492c-9dfa-dfc0101d0ec7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.191193 Oct 14 03:09:32.444950 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 124/251] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:32 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:32.450065 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a20dcb10-04d6-4641-b566-7946dbd4f4fb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d9ea303-3b32-4e79-9633-1de971d83f37"}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:32.453254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a20dcb10-04d6-4641-b566-7946dbd4f4fb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:32.459985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a20dcb10-04d6-4641-b566-7946dbd4f4fb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:32.460594 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a20dcb10-04d6-4641-b566-7946dbd4f4fb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:32.461211 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a20dcb10-04d6-4641-b566-7946dbd4f4fb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:32.462358 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a20dcb10-04d6-4641-b566-7946dbd4f4fb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:32.462824 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a20dcb10-04d6-4641-b566-7946dbd4f4fb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:32.463228 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a20dcb10-04d6-4641-b566-7946dbd4f4fb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:32.504958 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c03f0919-dcd6-4bb9-99d1-d6dd70d744e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:32.505583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c03f0919-dcd6-4bb9-99d1-d6dd70d744e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:32.514481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c03f0919-dcd6-4bb9-99d1-d6dd70d744e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:32.514983 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c03f0919-dcd6-4bb9-99d1-d6dd70d744e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:32.515422 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c03f0919-dcd6-4bb9-99d1-d6dd70d744e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:32.516130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c03f0919-dcd6-4bb9-99d1-d6dd70d744e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:32.516848 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c03f0919-dcd6-4bb9-99d1-d6dd70d744e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:32.517069 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c03f0919-dcd6-4bb9-99d1-d6dd70d744e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:32.678567 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c03f0919-dcd6-4bb9-99d1-d6dd70d744e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:32.693413 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c03f0919-dcd6-4bb9-99d1-d6dd70d744e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:32.695214 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c03f0919-dcd6-4bb9-99d1-d6dd70d744e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:32.696765 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c03f0919-dcd6-4bb9-99d1-d6dd70d744e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.196965 Oct 14 03:09:32.697515 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 125/252] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:32 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:09:32.702564 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-bc2e94ad-0b84-4332-8d49-dad6c69350b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:32.709051 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bc2e94ad-0b84-4332-8d49-dad6c69350b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:32.712787 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bc2e94ad-0b84-4332-8d49-dad6c69350b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:32.712787 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bc2e94ad-0b84-4332-8d49-dad6c69350b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:32.713800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:32.772930 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-bc2e94ad-0b84-4332-8d49-dad6c69350b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Going to try to stop instance {{(pid=119302) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 14 03:09:32.998601 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-bc2e94ad-0b84-4332-8d49-dad6c69350b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "POST /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/action" status: 202 len: 0 microversion: 2.1 time: 0.299666 Oct 14 03:09:32.999282 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 126/253] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Oct 14 03:09:32 2022] POST /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:09:33.008238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-737797ee-5c67-48dc-9ddf-b0ea7f6125c8 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:33.008976 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-737797ee-5c67-48dc-9ddf-b0ea7f6125c8 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:33.017979 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-737797ee-5c67-48dc-9ddf-b0ea7f6125c8 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:33.021135 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-737797ee-5c67-48dc-9ddf-b0ea7f6125c8 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:33.021135 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-737797ee-5c67-48dc-9ddf-b0ea7f6125c8 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:33.021135 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-737797ee-5c67-48dc-9ddf-b0ea7f6125c8 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:33.021135 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-737797ee-5c67-48dc-9ddf-b0ea7f6125c8 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:33.021737 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-737797ee-5c67-48dc-9ddf-b0ea7f6125c8 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:33.166160 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-737797ee-5c67-48dc-9ddf-b0ea7f6125c8 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:33.175871 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-737797ee-5c67-48dc-9ddf-b0ea7f6125c8 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1723 microversion: 2.1 time: 0.172194 Oct 14 03:09:33.176531 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 127/254] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:33 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:33.260238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ef7a9c56-adff-41a5-bb92-f3cc52e40d73 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:33.261500 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ef7a9c56-adff-41a5-bb92-f3cc52e40d73 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:33.268529 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ef7a9c56-adff-41a5-bb92-f3cc52e40d73 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:33.269199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ef7a9c56-adff-41a5-bb92-f3cc52e40d73 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:33.269639 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ef7a9c56-adff-41a5-bb92-f3cc52e40d73 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:33.270331 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ef7a9c56-adff-41a5-bb92-f3cc52e40d73 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:33.270794 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ef7a9c56-adff-41a5-bb92-f3cc52e40d73 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:33.271209 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ef7a9c56-adff-41a5-bb92-f3cc52e40d73 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:33.305633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ef7a9c56-adff-41a5-bb92-f3cc52e40d73 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:33.306119 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ef7a9c56-adff-41a5-bb92-f3cc52e40d73 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:33.306555 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ef7a9c56-adff-41a5-bb92-f3cc52e40d73 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:33.307001 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-ef7a9c56-adff-41a5-bb92-f3cc52e40d73 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lazy-loading 'fault' on Instance uuid 821d8281-460e-4bd2-acf4-ad27ebfc3bbd {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:09:33.315230 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a20dcb10-04d6-4641-b566-7946dbd4f4fb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "POST /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.872581 Oct 14 03:09:33.316111 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 128/255] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Oct 14 03:09:32 2022] POST /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d/os-volume_attachments => generated 194 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:33.362382 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ef7a9c56-adff-41a5-bb92-f3cc52e40d73 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:33.380569 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ef7a9c56-adff-41a5-bb92-f3cc52e40d73 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1303 microversion: 2.1 time: 0.117703 Oct 14 03:09:33.380569 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 128/256] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:33 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1303 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:33.458297 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0986ecc8-c664-4eff-84af-c80b86157489 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:33.458986 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0986ecc8-c664-4eff-84af-c80b86157489 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:33.465083 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0986ecc8-c664-4eff-84af-c80b86157489 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:33.465558 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0986ecc8-c664-4eff-84af-c80b86157489 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:33.465988 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0986ecc8-c664-4eff-84af-c80b86157489 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:33.466664 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0986ecc8-c664-4eff-84af-c80b86157489 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:33.467111 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0986ecc8-c664-4eff-84af-c80b86157489 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:33.467529 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0986ecc8-c664-4eff-84af-c80b86157489 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:33.605199 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0986ecc8-c664-4eff-84af-c80b86157489 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:33.613032 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0986ecc8-c664-4eff-84af-c80b86157489 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.159266 Oct 14 03:09:33.613606 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 129/257] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:33 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:33.724370 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3c5b8c15-d795-4403-999d-14f105d4b5a2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:33.725006 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-3c5b8c15-d795-4403-999d-14f105d4b5a2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:33.731386 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3c5b8c15-d795-4403-999d-14f105d4b5a2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:33.731792 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3c5b8c15-d795-4403-999d-14f105d4b5a2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:33.732448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3c5b8c15-d795-4403-999d-14f105d4b5a2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:33.733140 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3c5b8c15-d795-4403-999d-14f105d4b5a2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:33.733602 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3c5b8c15-d795-4403-999d-14f105d4b5a2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:33.734019 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3c5b8c15-d795-4403-999d-14f105d4b5a2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:34.055109 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3c5b8c15-d795-4403-999d-14f105d4b5a2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:34.063639 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3c5b8c15-d795-4403-999d-14f105d4b5a2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:34.065106 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3c5b8c15-d795-4403-999d-14f105d4b5a2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:34.066258 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-3c5b8c15-d795-4403-999d-14f105d4b5a2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.345999 Oct 14 03:09:34.066808 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 129/258] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:33 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:09:34.198955 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-be664e6f-c233-4585-a708-edc4dfd00d4c tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:34.199564 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-be664e6f-c233-4585-a708-edc4dfd00d4c tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:34.201965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:34.210426 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-be664e6f-c233-4585-a708-edc4dfd00d4c tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:34.211303 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-be664e6f-c233-4585-a708-edc4dfd00d4c tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:34.212086 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-be664e6f-c233-4585-a708-edc4dfd00d4c tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:34.213358 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-be664e6f-c233-4585-a708-edc4dfd00d4c tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:34.214042 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-be664e6f-c233-4585-a708-edc4dfd00d4c tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:34.214601 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-be664e6f-c233-4585-a708-edc4dfd00d4c tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:34.401908 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e3b0f544-fdff-4e5f-8d8b-843ea1a54502 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:34.402525 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e3b0f544-fdff-4e5f-8d8b-843ea1a54502 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:34.408974 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e3b0f544-fdff-4e5f-8d8b-843ea1a54502 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:34.409483 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e3b0f544-fdff-4e5f-8d8b-843ea1a54502 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:34.410158 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e3b0f544-fdff-4e5f-8d8b-843ea1a54502 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:34.410999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e3b0f544-fdff-4e5f-8d8b-843ea1a54502 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:34.411662 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e3b0f544-fdff-4e5f-8d8b-843ea1a54502 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:34.411918 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e3b0f544-fdff-4e5f-8d8b-843ea1a54502 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:34.480405 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e3b0f544-fdff-4e5f-8d8b-843ea1a54502 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:34.484475 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e3b0f544-fdff-4e5f-8d8b-843ea1a54502 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:34.501161 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e3b0f544-fdff-4e5f-8d8b-843ea1a54502 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:34.501161 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-e3b0f544-fdff-4e5f-8d8b-843ea1a54502 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lazy-loading 'fault' on Instance uuid 821d8281-460e-4bd2-acf4-ad27ebfc3bbd {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:09:34.550810 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e3b0f544-fdff-4e5f-8d8b-843ea1a54502 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ae4a16f6004c1ba3ac3ee19def9399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2672469044ae418186a01036e653f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:34.561164 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e3b0f544-fdff-4e5f-8d8b-843ea1a54502 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 200 len: 1303 microversion: 2.1 time: 0.163985 Oct 14 03:09:34.561750 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 130/259] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:34 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 1303 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:34.599037 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-be664e6f-c233-4585-a708-edc4dfd00d4c tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:34.607521 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-be664e6f-c233-4585-a708-edc4dfd00d4c tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1723 microversion: 2.1 time: 0.412412 Oct 14 03:09:34.611005 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 130/260] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:34 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1723 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:34.637850 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-43eb52a1-a220-4f78-9e77-c51f5988879d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:34.638551 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-43eb52a1-a220-4f78-9e77-c51f5988879d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:34.644518 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-43eb52a1-a220-4f78-9e77-c51f5988879d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:34.645007 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-43eb52a1-a220-4f78-9e77-c51f5988879d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:34.645448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-43eb52a1-a220-4f78-9e77-c51f5988879d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:34.646146 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-43eb52a1-a220-4f78-9e77-c51f5988879d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:34.646603 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-43eb52a1-a220-4f78-9e77-c51f5988879d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:34.647620 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-43eb52a1-a220-4f78-9e77-c51f5988879d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:34.789730 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-43eb52a1-a220-4f78-9e77-c51f5988879d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:34.799096 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-43eb52a1-a220-4f78-9e77-c51f5988879d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.165074 Oct 14 03:09:34.799675 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 131/261] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:34 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:35.090626 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-de7c7e81-65cb-4187-b0b1-33fa9464dd62 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:35.091232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-de7c7e81-65cb-4187-b0b1-33fa9464dd62 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:35.097170 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-de7c7e81-65cb-4187-b0b1-33fa9464dd62 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:35.097839 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-de7c7e81-65cb-4187-b0b1-33fa9464dd62 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:35.098274 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-de7c7e81-65cb-4187-b0b1-33fa9464dd62 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:35.098972 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-de7c7e81-65cb-4187-b0b1-33fa9464dd62 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:35.099423 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-de7c7e81-65cb-4187-b0b1-33fa9464dd62 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:35.099867 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-de7c7e81-65cb-4187-b0b1-33fa9464dd62 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:35.242070 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-de7c7e81-65cb-4187-b0b1-33fa9464dd62 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:35.250275 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-de7c7e81-65cb-4187-b0b1-33fa9464dd62 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:35.251910 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-de7c7e81-65cb-4187-b0b1-33fa9464dd62 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:35.253085 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-de7c7e81-65cb-4187-b0b1-33fa9464dd62 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.166370 Oct 14 03:09:35.253647 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 131/262] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:35 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:35.586280 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b7f43ca9-b391-413b-ac5f-fad740c03c65 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:35.587104 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b7f43ca9-b391-413b-ac5f-fad740c03c65 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] [instance: 821d8281-460e-4bd2-acf4-ad27ebfc3bbd] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:35.589847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:35.594585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b7f43ca9-b391-413b-ac5f-fad740c03c65 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:35.595237 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b7f43ca9-b391-413b-ac5f-fad740c03c65 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:35.595594 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b7f43ca9-b391-413b-ac5f-fad740c03c65 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:35.596363 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b7f43ca9-b391-413b-ac5f-fad740c03c65 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:35.596848 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b7f43ca9-b391-413b-ac5f-fad740c03c65 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:35.597337 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b7f43ca9-b391-413b-ac5f-fad740c03c65 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:35.611923 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-b7f43ca9-b391-413b-ac5f-fad740c03c65 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] HTTP exception thrown: Instance 821d8281-460e-4bd2-acf4-ad27ebfc3bbd could not be found. Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b7f43ca9-b391-413b-ac5f-fad740c03c65 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Request method failure captured: Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd HTTP/1.1 Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNLQwbweVO9G0BiIReBFjUV7cTNLdTx9C84zzIbwMBJMkUvcPzWxb5Jl7ZhQFDnIua6jmCjP6f04WkVDwXICzIBNOOtJQZpcjXMZTR4pnToJdbeU_ZCFjBkGkehdwI-mN0cJjvmP-sCooqV-pjTTodZg7w6pFk-qzDESPgXFvMyiaAs Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 2672469044ae418186a01036e653f609 Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-VolumesActionsTest-617600331 Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:09:35.614633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:09:35.616272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2672469044ae418186a01036e653f609"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2672469044ae418186a01036e653f609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2672469044ae418186a01036e653f609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2672469044ae418186a01036e653f609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:09:35.616272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-VolumesActionsTest-617600331 Oct 14 03:09:35.616272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 2672469044ae418186a01036e653f609 Oct 14 03:09:35.616272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-VolumesActionsTest-617600331 Oct 14 03:09:35.616272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-VolumesActionsTest-617600331-project Oct 14 03:09:35.616272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:09:35.616272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:09:35.616272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 73ae4a16f6004c1ba3ac3ee19def9399 Oct 14 03:09:35.616272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-VolumesActionsTest-617600331-project Oct 14 03:09:35.616272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:09:35.616272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 821d8281-460e-4bd2-acf4-ad27ebfc3bbd could not be found. Oct 14 03:09:35.616272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': '821d8281-460e-4bd2-acf4-ad27ebfc3bbd'} Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 821d8281-460e-4bd2-acf4-ad27ebfc3bbd could not be found. Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:09:35.617181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 821d8281-460e-4bd2-acf4-ad27ebfc3bbd could not be found. Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 821d8281-460e-4bd2-acf4-ad27ebfc3bbd could not be found. Oct 14 03:09:35.618557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:09:35.619734 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b7f43ca9-b391-413b-ac5f-fad740c03c65 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] Returning 404 to user: Instance 821d8281-460e-4bd2-acf4-ad27ebfc3bbd could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:09:35.619734 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b7f43ca9-b391-413b-ac5f-fad740c03c65 tempest-VolumesActionsTest-617600331 tempest-VolumesActionsTest-617600331-project] 10.222.0.13 "GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd" status: 404 len: 111 microversion: 2.1 time: 0.033498 Oct 14 03:09:35.619734 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 132/263] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:35 2022] GET /compute/v2.1/servers/821d8281-460e-4bd2-acf4-ad27ebfc3bbd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:09:35.632310 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-00559403-748b-4f3b-8a9c-f5a5a428545e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:35.633043 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-00559403-748b-4f3b-8a9c-f5a5a428545e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:35.643700 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-00559403-748b-4f3b-8a9c-f5a5a428545e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:35.643700 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-00559403-748b-4f3b-8a9c-f5a5a428545e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:35.643700 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-00559403-748b-4f3b-8a9c-f5a5a428545e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:35.643700 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-00559403-748b-4f3b-8a9c-f5a5a428545e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:35.643986 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-00559403-748b-4f3b-8a9c-f5a5a428545e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:35.643986 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-00559403-748b-4f3b-8a9c-f5a5a428545e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:35.789172 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-00559403-748b-4f3b-8a9c-f5a5a428545e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:35.797282 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-00559403-748b-4f3b-8a9c-f5a5a428545e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1723 microversion: 2.1 time: 0.169366 Oct 14 03:09:35.797827 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 132/264] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:35 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:35.823711 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b3432386-053d-4a02-8d8d-748b58b94648 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:35.824592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b3432386-053d-4a02-8d8d-748b58b94648 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:35.832165 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3432386-053d-4a02-8d8d-748b58b94648 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:35.832755 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3432386-053d-4a02-8d8d-748b58b94648 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:35.833273 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3432386-053d-4a02-8d8d-748b58b94648 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:35.834243 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3432386-053d-4a02-8d8d-748b58b94648 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:35.835314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3432386-053d-4a02-8d8d-748b58b94648 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:35.835944 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3432386-053d-4a02-8d8d-748b58b94648 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:35.998655 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b3432386-053d-4a02-8d8d-748b58b94648 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:36.006929 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b3432386-053d-4a02-8d8d-748b58b94648 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.186867 Oct 14 03:09:36.007492 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 133/265] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:35 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:36.278055 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-df319287-4304-4ad0-a66b-2ea4d16f396e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:36.278776 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-df319287-4304-4ad0-a66b-2ea4d16f396e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:36.285442 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-df319287-4304-4ad0-a66b-2ea4d16f396e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:36.286133 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-df319287-4304-4ad0-a66b-2ea4d16f396e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:36.286336 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-df319287-4304-4ad0-a66b-2ea4d16f396e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:36.287040 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-df319287-4304-4ad0-a66b-2ea4d16f396e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:36.287524 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-df319287-4304-4ad0-a66b-2ea4d16f396e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:36.287952 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-df319287-4304-4ad0-a66b-2ea4d16f396e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:36.477264 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-df319287-4304-4ad0-a66b-2ea4d16f396e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:36.485777 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-df319287-4304-4ad0-a66b-2ea4d16f396e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:36.487326 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-df319287-4304-4ad0-a66b-2ea4d16f396e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:36.488641 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-df319287-4304-4ad0-a66b-2ea4d16f396e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.214492 Oct 14 03:09:36.489220 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 133/266] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:36 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:36.820671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-996d98f1-b620-4ef2-9349-6373ea693576 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:36.822281 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-996d98f1-b620-4ef2-9349-6373ea693576 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:36.827373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-996d98f1-b620-4ef2-9349-6373ea693576 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:36.827858 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-996d98f1-b620-4ef2-9349-6373ea693576 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:36.828296 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-996d98f1-b620-4ef2-9349-6373ea693576 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:36.829842 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-996d98f1-b620-4ef2-9349-6373ea693576 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:36.829842 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-996d98f1-b620-4ef2-9349-6373ea693576 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:36.830151 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-996d98f1-b620-4ef2-9349-6373ea693576 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:37.016631 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-996d98f1-b620-4ef2-9349-6373ea693576 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:37.025604 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-996d98f1-b620-4ef2-9349-6373ea693576 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1723 microversion: 2.1 time: 0.208920 Oct 14 03:09:37.026463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 134/267] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:36 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:37.030446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-18367e14-c782-44d8-8a8e-0bb19f1b0862 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:37.031102 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-18367e14-c782-44d8-8a8e-0bb19f1b0862 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:37.036999 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-18367e14-c782-44d8-8a8e-0bb19f1b0862 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:37.038099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-18367e14-c782-44d8-8a8e-0bb19f1b0862 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:37.038540 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-18367e14-c782-44d8-8a8e-0bb19f1b0862 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:37.039227 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-18367e14-c782-44d8-8a8e-0bb19f1b0862 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:37.039680 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-18367e14-c782-44d8-8a8e-0bb19f1b0862 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:37.040103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-18367e14-c782-44d8-8a8e-0bb19f1b0862 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:37.180979 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-18367e14-c782-44d8-8a8e-0bb19f1b0862 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:37.188743 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-18367e14-c782-44d8-8a8e-0bb19f1b0862 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1501 microversion: 2.1 time: 0.162292 Oct 14 03:09:37.189353 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 134/268] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:37 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:37.212005 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-877dd292-5aa4-4f08-ac21-acf4552b5066 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1fcecad-e2d2-4b2d-aeb4-a1caa0cd35cc"}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:37.214517 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-877dd292-5aa4-4f08-ac21-acf4552b5066 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:37.220493 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-877dd292-5aa4-4f08-ac21-acf4552b5066 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:37.220987 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-877dd292-5aa4-4f08-ac21-acf4552b5066 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:37.221458 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-877dd292-5aa4-4f08-ac21-acf4552b5066 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:37.222192 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-877dd292-5aa4-4f08-ac21-acf4552b5066 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:37.222706 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-877dd292-5aa4-4f08-ac21-acf4552b5066 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:37.223082 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-877dd292-5aa4-4f08-ac21-acf4552b5066 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:37.248417 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-877dd292-5aa4-4f08-ac21-acf4552b5066 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] HTTP exception thrown: Cannot 'attach_volume' instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 while it is in vm_state rescued Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-877dd292-5aa4-4f08-ac21-acf4552b5066 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Request method failure captured: Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: POST /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7/os-volume_attachments HTTP/1.1 Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 74 Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKH4NxEPMl2MiNB1XCe-xt7krq1NrhiwWzh8PUcUNc7DPMToyK61BYEVmqnH8PcIjU4NdaDSCKUk9p7hizeKHSG12vRmixqmA6Av241GRS3ISj8jYf2FW8S0N5rYB7-2yQkL3Hn58t-PG07p68TryoPL80eVR0qFpm0wcS-Fmdl0QQ Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 61f89b8e68d14d3d96fa84ab1697fcea Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:09:37.250021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:09:37.251381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:09:37.251381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:09:37.251381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 61f89b8e68d14d3d96fa84ab1697fcea Oct 14 03:09:37.251381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:09:37.251381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-ServerRescueNegativeTestJSON-883339385-project Oct 14 03:09:37.251381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:09:37.251381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:09:37.251381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: dbf0723a0f3942d2b9b2554320878016 Oct 14 03:09:37.251381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-ServerRescueNegativeTestJSON-883339385-project Oct 14 03:09:37.251381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Oct 14 03:09:37.251381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {"volumeAttachment": {"volumeId": "d1fcecad-e2d2-4b2d-aeb4-a1caa0cd35cc"}} Oct 14 03:09:37.251381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Cannot 'attach_volume' instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 while it is in vm_state rescued Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'server_id': 'd77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7', 'body': {'volumeAttachment': {'volumeId': 'd1fcecad-e2d2-4b2d-aeb4-a1caa0cd35cc'}}} Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:09:37.255723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 while it is in vm_state rescued Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:09:37.257074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:09:37.258440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:09:37.258440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:09:37.258440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 while it is in vm_state rescued Oct 14 03:09:37.258440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:09:37.258440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-877dd292-5aa4-4f08-ac21-acf4552b5066 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Returning 409 to user: Cannot 'attach_volume' instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 while it is in vm_state rescued {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:09:37.258440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-877dd292-5aa4-4f08-ac21-acf4552b5066 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "POST /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044289 Oct 14 03:09:37.258440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 135/269] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Oct 14 03:09:37 2022] POST /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 14 03:09:37.273782 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-886f0bf5-2eaa-43aa-ad1a-745832ad49f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:37.274494 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-886f0bf5-2eaa-43aa-ad1a-745832ad49f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:37.286450 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-886f0bf5-2eaa-43aa-ad1a-745832ad49f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:37.290801 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-886f0bf5-2eaa-43aa-ad1a-745832ad49f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:37.291254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-886f0bf5-2eaa-43aa-ad1a-745832ad49f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:37.291991 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-886f0bf5-2eaa-43aa-ad1a-745832ad49f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:37.292523 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-886f0bf5-2eaa-43aa-ad1a-745832ad49f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:37.292957 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-886f0bf5-2eaa-43aa-ad1a-745832ad49f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:37.518854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-1f51f16c-9b81-4cd9-92d4-837a5537fbcc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:37.519973 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-1f51f16c-9b81-4cd9-92d4-837a5537fbcc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:37.563172 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1f51f16c-9b81-4cd9-92d4-837a5537fbcc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:37.563858 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1f51f16c-9b81-4cd9-92d4-837a5537fbcc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:37.564311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1f51f16c-9b81-4cd9-92d4-837a5537fbcc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:37.570766 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1f51f16c-9b81-4cd9-92d4-837a5537fbcc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:37.571039 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1f51f16c-9b81-4cd9-92d4-837a5537fbcc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:37.571486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1f51f16c-9b81-4cd9-92d4-837a5537fbcc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:37.617371 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-886f0bf5-2eaa-43aa-ad1a-745832ad49f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "POST /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7/action" status: 202 len: 0 microversion: 2.1 time: 0.357093 Oct 14 03:09:37.621084 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 135/270] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Oct 14 03:09:37 2022] POST /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:09:37.644590 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8ab5557c-d56d-4201-b753-12b38127938a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:37.645505 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8ab5557c-d56d-4201-b753-12b38127938a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:37.677493 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8ab5557c-d56d-4201-b753-12b38127938a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:37.677493 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8ab5557c-d56d-4201-b753-12b38127938a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:37.677493 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8ab5557c-d56d-4201-b753-12b38127938a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:37.678369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8ab5557c-d56d-4201-b753-12b38127938a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:37.678702 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8ab5557c-d56d-4201-b753-12b38127938a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:37.679143 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8ab5557c-d56d-4201-b753-12b38127938a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:38.051067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1f51f16c-9b81-4cd9-92d4-837a5537fbcc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:38.062455 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1f51f16c-9b81-4cd9-92d4-837a5537fbcc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:38.064580 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1f51f16c-9b81-4cd9-92d4-837a5537fbcc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:38.070950 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-1f51f16c-9b81-4cd9-92d4-837a5537fbcc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.557320 Oct 14 03:09:38.113508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 136/271] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:37 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:38.122933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8a1df9a5-3703-476b-a10f-b86c7731e22b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:38.124430 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8a1df9a5-3703-476b-a10f-b86c7731e22b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:38.133052 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a1df9a5-3703-476b-a10f-b86c7731e22b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:38.133596 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a1df9a5-3703-476b-a10f-b86c7731e22b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:38.134274 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a1df9a5-3703-476b-a10f-b86c7731e22b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:38.135181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a1df9a5-3703-476b-a10f-b86c7731e22b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:38.135736 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a1df9a5-3703-476b-a10f-b86c7731e22b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:38.136348 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a1df9a5-3703-476b-a10f-b86c7731e22b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:38.182834 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8ab5557c-d56d-4201-b753-12b38127938a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:38.189091 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:38.193005 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8ab5557c-d56d-4201-b753-12b38127938a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1509 microversion: 2.1 time: 0.560807 Oct 14 03:09:38.194349 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 136/272] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:37 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1509 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:38.202376 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-7c5a975a-a1c5-4d63-8195-e77fcd99684d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Action: 'create', calling method: .version_select at 0x7fdcc77c0820>, body: {"keypair": {"name": "tempest-keypair-784416825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIle+cJDL9ZzQLEU7dMYg64fMgKkhkBmtx1mNUESQ9V0GvPm74w2ODB0vcDUisqoQx+N4JUqr3+7Lc42HpsFFPHmijsO3wcGknJvUFszEURrcNRgh4/DA9Absdo+z7s5A=="}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:38.220932 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-7c5a975a-a1c5-4d63-8195-e77fcd99684d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:09:38.228305 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-7c5a975a-a1c5-4d63-8195-e77fcd99684d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for user 4553b7573ca34af6a9fdb94f80717f24 and project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:09:38.368267 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-7c5a975a-a1c5-4d63-8195-e77fcd99684d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.172617 Oct 14 03:09:38.369585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 137/273] 10.222.0.13 () {60 vars in 1159 bytes} [Fri Oct 14 03:09:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:38.478249 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8a1df9a5-3703-476b-a10f-b86c7731e22b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:38.489424 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8a1df9a5-3703-476b-a10f-b86c7731e22b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1723 microversion: 2.1 time: 0.374575 Oct 14 03:09:38.490010 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 137/274] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:38 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1723 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:39.101974 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-bde535f8-0e37-4fd4-aba1-78305b61dc8b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:39.102797 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-bde535f8-0e37-4fd4-aba1-78305b61dc8b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:39.109744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bde535f8-0e37-4fd4-aba1-78305b61dc8b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:39.112192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bde535f8-0e37-4fd4-aba1-78305b61dc8b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:39.112192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bde535f8-0e37-4fd4-aba1-78305b61dc8b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:39.112192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bde535f8-0e37-4fd4-aba1-78305b61dc8b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:39.113573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bde535f8-0e37-4fd4-aba1-78305b61dc8b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:39.114078 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bde535f8-0e37-4fd4-aba1-78305b61dc8b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:39.218319 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-46df1021-ad98-4ba8-aa39-c7c70f791bef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:39.219591 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-46df1021-ad98-4ba8-aa39-c7c70f791bef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:39.228423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46df1021-ad98-4ba8-aa39-c7c70f791bef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:39.229315 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46df1021-ad98-4ba8-aa39-c7c70f791bef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:39.230163 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46df1021-ad98-4ba8-aa39-c7c70f791bef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:39.231725 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46df1021-ad98-4ba8-aa39-c7c70f791bef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:39.232425 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46df1021-ad98-4ba8-aa39-c7c70f791bef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:39.233007 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-46df1021-ad98-4ba8-aa39-c7c70f791bef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:39.363880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-bde535f8-0e37-4fd4-aba1-78305b61dc8b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:39.373018 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-bde535f8-0e37-4fd4-aba1-78305b61dc8b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:39.376580 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-bde535f8-0e37-4fd4-aba1-78305b61dc8b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:39.377779 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-bde535f8-0e37-4fd4-aba1-78305b61dc8b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.281501 Oct 14 03:09:39.406706 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 138/275] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:39 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:09:39.521660 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-995bee72-fd34-4d1e-98b4-d2dd017e1454 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:39.523791 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-995bee72-fd34-4d1e-98b4-d2dd017e1454 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:39.532561 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-46df1021-ad98-4ba8-aa39-c7c70f791bef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:39.541027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-995bee72-fd34-4d1e-98b4-d2dd017e1454 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:39.541941 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-995bee72-fd34-4d1e-98b4-d2dd017e1454 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:39.542576 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-995bee72-fd34-4d1e-98b4-d2dd017e1454 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:39.543663 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-46df1021-ad98-4ba8-aa39-c7c70f791bef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1509 microversion: 2.1 time: 0.328850 Oct 14 03:09:39.544107 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 138/276] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:39 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:39.559397 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-995bee72-fd34-4d1e-98b4-d2dd017e1454 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:39.560405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-995bee72-fd34-4d1e-98b4-d2dd017e1454 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:39.566326 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-995bee72-fd34-4d1e-98b4-d2dd017e1454 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:39.842121 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-995bee72-fd34-4d1e-98b4-d2dd017e1454 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:39.847690 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-995bee72-fd34-4d1e-98b4-d2dd017e1454 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1723 microversion: 2.1 time: 0.337564 Oct 14 03:09:39.848454 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 139/277] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:39 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:40.412996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-5e45d934-e93a-4a78-aa9e-b7b13019151f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:40.412996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-5e45d934-e93a-4a78-aa9e-b7b13019151f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:40.423081 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5e45d934-e93a-4a78-aa9e-b7b13019151f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:40.423903 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5e45d934-e93a-4a78-aa9e-b7b13019151f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:40.424906 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5e45d934-e93a-4a78-aa9e-b7b13019151f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:40.426041 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5e45d934-e93a-4a78-aa9e-b7b13019151f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:40.426881 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5e45d934-e93a-4a78-aa9e-b7b13019151f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:40.427530 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5e45d934-e93a-4a78-aa9e-b7b13019151f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:40.574696 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0812b281-9206-4e42-9eaf-83cdc8c801e4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:40.576299 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0812b281-9206-4e42-9eaf-83cdc8c801e4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:40.589299 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0812b281-9206-4e42-9eaf-83cdc8c801e4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:40.591524 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0812b281-9206-4e42-9eaf-83cdc8c801e4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:40.591972 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0812b281-9206-4e42-9eaf-83cdc8c801e4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:40.592743 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0812b281-9206-4e42-9eaf-83cdc8c801e4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:40.593201 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0812b281-9206-4e42-9eaf-83cdc8c801e4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:40.596707 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0812b281-9206-4e42-9eaf-83cdc8c801e4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:40.777449 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5e45d934-e93a-4a78-aa9e-b7b13019151f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:40.804029 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5e45d934-e93a-4a78-aa9e-b7b13019151f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:40.807022 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5e45d934-e93a-4a78-aa9e-b7b13019151f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:40.808557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-5e45d934-e93a-4a78-aa9e-b7b13019151f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.401497 Oct 14 03:09:40.814185 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0812b281-9206-4e42-9eaf-83cdc8c801e4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:40.832278 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 139/278] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:40 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:40.832765 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0812b281-9206-4e42-9eaf-83cdc8c801e4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1509 microversion: 2.1 time: 0.253131 Oct 14 03:09:40.832765 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 140/279] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:40 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:40.873099 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ecba3a51-1349-4997-aaf1-047db717da2b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:40.873715 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ecba3a51-1349-4997-aaf1-047db717da2b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:40.879855 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ecba3a51-1349-4997-aaf1-047db717da2b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:40.880601 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ecba3a51-1349-4997-aaf1-047db717da2b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:40.881598 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ecba3a51-1349-4997-aaf1-047db717da2b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:40.882302 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ecba3a51-1349-4997-aaf1-047db717da2b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:40.883098 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ecba3a51-1349-4997-aaf1-047db717da2b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:40.883539 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ecba3a51-1349-4997-aaf1-047db717da2b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:41.144144 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ecba3a51-1349-4997-aaf1-047db717da2b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:41.156692 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ecba3a51-1349-4997-aaf1-047db717da2b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1723 microversion: 2.1 time: 0.286966 Oct 14 03:09:41.159187 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 140/280] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:40 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:41.589371 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-485362292", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fcf48d6-7187-4929-b5fb-8bc693b44fb9"}], "security_groups": [{"name": "tempest-securitygroup--124647218"}], "key_name": "tempest-keypair-784416825", "user_data": "}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:41.751429 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.network.neutron [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] validate_networks() for [('9fcf48d6-7187-4929-b5fb-8bc693b44fb9', None, None, None, None, None)] {{(pid=119301) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:09:41.844270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2df2a5f5-6bea-4512-b3e8-251c160c0423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:41.846516 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2df2a5f5-6bea-4512-b3e8-251c160c0423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:41.856362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2df2a5f5-6bea-4512-b3e8-251c160c0423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:41.856960 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2df2a5f5-6bea-4512-b3e8-251c160c0423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:41.857749 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2df2a5f5-6bea-4512-b3e8-251c160c0423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:41.858522 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2df2a5f5-6bea-4512-b3e8-251c160c0423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:41.859103 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2df2a5f5-6bea-4512-b3e8-251c160c0423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:41.859745 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2df2a5f5-6bea-4512-b3e8-251c160c0423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:42.111438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2df2a5f5-6bea-4512-b3e8-251c160c0423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:42.126510 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2df2a5f5-6bea-4512-b3e8-251c160c0423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:42.128753 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2df2a5f5-6bea-4512-b3e8-251c160c0423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:42.130481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2df2a5f5-6bea-4512-b3e8-251c160c0423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.289996 Oct 14 03:09:42.152484 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 141/281] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:41 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:09:42.159607 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c456adbe-b887-495e-8123-06ccdd8adda2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:42.160625 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c456adbe-b887-495e-8123-06ccdd8adda2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:42.175486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c456adbe-b887-495e-8123-06ccdd8adda2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:42.175981 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c456adbe-b887-495e-8123-06ccdd8adda2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:42.177829 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c456adbe-b887-495e-8123-06ccdd8adda2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:42.179370 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c456adbe-b887-495e-8123-06ccdd8adda2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:42.180015 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c456adbe-b887-495e-8123-06ccdd8adda2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:42.180689 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c456adbe-b887-495e-8123-06ccdd8adda2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:42.187443 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:42.493859 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c456adbe-b887-495e-8123-06ccdd8adda2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:42.503836 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c456adbe-b887-495e-8123-06ccdd8adda2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1515 microversion: 2.1 time: 0.349513 Oct 14 03:09:42.505286 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 142/282] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:42 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1515 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:42.512865 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Flavor limits 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:09:42.513295 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Image limits 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:09:42.514103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Flavor pref 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:09:42.514520 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Image pref 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:09:42.514936 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:09:42.524321 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:42.524520 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-7da8e680-f9b7-465a-8302-d79fc87b26c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:42.525294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-7da8e680-f9b7-465a-8302-d79fc87b26c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:42.525514 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:42.526143 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:42.527545 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:42.528195 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:42.528987 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:42.537690 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7da8e680-f9b7-465a-8302-d79fc87b26c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:42.538276 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7da8e680-f9b7-465a-8302-d79fc87b26c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:42.539247 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7da8e680-f9b7-465a-8302-d79fc87b26c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:42.539981 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7da8e680-f9b7-465a-8302-d79fc87b26c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:42.540475 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7da8e680-f9b7-465a-8302-d79fc87b26c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:42.541177 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7da8e680-f9b7-465a-8302-d79fc87b26c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:42.557076 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'instances', 'ram', 'cores'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:09:42.561880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for user 4553b7573ca34af6a9fdb94f80717f24 and project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'instances', 'ram', 'cores'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:09:42.585264 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Going to run 1 instances... {{(pid=119301) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:09:42.589805 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119301) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:09:42.761306 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-119e45e9-d659-4a7d-886a-5aa5bd6088c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.177215 Oct 14 03:09:42.762979 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 141/283] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:09:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:09:42.780126 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fd75c25d-42fc-4c1d-968e-cb35b1f4b310 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:42.781259 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fd75c25d-42fc-4c1d-968e-cb35b1f4b310 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:42.897479 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fd75c25d-42fc-4c1d-968e-cb35b1f4b310 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:42.905019 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fd75c25d-42fc-4c1d-968e-cb35b1f4b310 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1240 microversion: 2.1 time: 0.133636 Oct 14 03:09:42.906143 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 142/284] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:42 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1240 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:42.921694 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7da8e680-f9b7-465a-8302-d79fc87b26c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:42.935961 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-7da8e680-f9b7-465a-8302-d79fc87b26c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1723 microversion: 2.1 time: 0.425557 Oct 14 03:09:42.936291 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 143/285] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:42 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1723 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:43.166713 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-037f855d-0306-4166-b147-2b99e2e078f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:43.167324 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-037f855d-0306-4166-b147-2b99e2e078f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:43.173659 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-037f855d-0306-4166-b147-2b99e2e078f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:43.174148 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-037f855d-0306-4166-b147-2b99e2e078f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:43.174609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-037f855d-0306-4166-b147-2b99e2e078f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:43.175347 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-037f855d-0306-4166-b147-2b99e2e078f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:43.176148 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-037f855d-0306-4166-b147-2b99e2e078f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:43.176763 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-037f855d-0306-4166-b147-2b99e2e078f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:43.320697 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-037f855d-0306-4166-b147-2b99e2e078f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:43.329289 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-037f855d-0306-4166-b147-2b99e2e078f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:43.330747 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-037f855d-0306-4166-b147-2b99e2e078f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:43.331909 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-037f855d-0306-4166-b147-2b99e2e078f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.169840 Oct 14 03:09:43.334274 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 143/286] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:43 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:43.945759 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-5d655211-413e-40bb-8b4b-0093b9b91fd2 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:43.954762 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-5d655211-413e-40bb-8b4b-0093b9b91fd2 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:43.963386 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d5f37623-2b49-4e51-8a4a-69f37945591f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:43.964121 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d5f37623-2b49-4e51-8a4a-69f37945591f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:43.970831 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d5f37623-2b49-4e51-8a4a-69f37945591f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:43.983609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d5f37623-2b49-4e51-8a4a-69f37945591f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:43.983609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d5f37623-2b49-4e51-8a4a-69f37945591f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:43.983609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d5f37623-2b49-4e51-8a4a-69f37945591f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:43.984097 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d5f37623-2b49-4e51-8a4a-69f37945591f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:43.984633 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d5f37623-2b49-4e51-8a4a-69f37945591f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:44.296028 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5d655211-413e-40bb-8b4b-0093b9b91fd2 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:44.303748 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-5d655211-413e-40bb-8b4b-0093b9b91fd2 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1240 microversion: 2.1 time: 0.376469 Oct 14 03:09:44.318355 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 144/287] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:43 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1240 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:44.358981 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6928592b-4c7e-4df5-b7c2-52275a163ad9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:44.359762 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6928592b-4c7e-4df5-b7c2-52275a163ad9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:44.364807 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d5f37623-2b49-4e51-8a4a-69f37945591f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:44.372312 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6928592b-4c7e-4df5-b7c2-52275a163ad9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:44.374389 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d5f37623-2b49-4e51-8a4a-69f37945591f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1723 microversion: 2.1 time: 0.416904 Oct 14 03:09:44.374973 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 144/288] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:43 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1723 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:44.375178 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6928592b-4c7e-4df5-b7c2-52275a163ad9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:44.375644 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6928592b-4c7e-4df5-b7c2-52275a163ad9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:44.376601 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6928592b-4c7e-4df5-b7c2-52275a163ad9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:44.385070 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6928592b-4c7e-4df5-b7c2-52275a163ad9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:44.385166 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6928592b-4c7e-4df5-b7c2-52275a163ad9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:44.541087 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6928592b-4c7e-4df5-b7c2-52275a163ad9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:44.550068 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6928592b-4c7e-4df5-b7c2-52275a163ad9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:44.551665 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6928592b-4c7e-4df5-b7c2-52275a163ad9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:44.553151 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6928592b-4c7e-4df5-b7c2-52275a163ad9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.197990 Oct 14 03:09:44.563189 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 145/289] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:44 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:45.044225 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-7542bab3-e54e-498c-a67f-2259be3e80a1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Action: 'create', calling method: .version_select at 0x7fdcc78a49d0>, body: {"keypair": {"name": "tempest-keypair-908666610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxh137FoO+kfMxRgfop8qwP7sm9XYpJl0oU5hUFh1CsyiVMnucYp3mcLCG5rwFgDRCLnkLxaI5TLvkvQyyex6inqstgowMIVDCxGROJni1jjn8tqACR4OMi1Jd/g9jNBw=="}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:45.063440 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-7542bab3-e54e-498c-a67f-2259be3e80a1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Getting quotas for project 61f89b8e68d14d3d96fa84ab1697fcea. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:09:45.068722 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-7542bab3-e54e-498c-a67f-2259be3e80a1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Getting quotas for user dbf0723a0f3942d2b9b2554320878016 and project 61f89b8e68d14d3d96fa84ab1697fcea. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:09:45.197013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-7542bab3-e54e-498c-a67f-2259be3e80a1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.156931 Oct 14 03:09:45.203672 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 145/290] 10.222.0.13 () {60 vars in 1159 bytes} [Fri Oct 14 03:09:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:45.349974 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-737cd5d0-ebe8-4c12-b354-e0fe0e9141c0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:45.352122 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-737cd5d0-ebe8-4c12-b354-e0fe0e9141c0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:45.363475 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-737cd5d0-ebe8-4c12-b354-e0fe0e9141c0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:45.364345 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-737cd5d0-ebe8-4c12-b354-e0fe0e9141c0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:45.365503 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-737cd5d0-ebe8-4c12-b354-e0fe0e9141c0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:45.366543 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-737cd5d0-ebe8-4c12-b354-e0fe0e9141c0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:45.367228 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-737cd5d0-ebe8-4c12-b354-e0fe0e9141c0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:45.367959 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-737cd5d0-ebe8-4c12-b354-e0fe0e9141c0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:45.399012 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fae0a2bc-7af5-48ad-8b15-f6cf8a70c841 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:45.406334 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fae0a2bc-7af5-48ad-8b15-f6cf8a70c841 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:45.410939 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fae0a2bc-7af5-48ad-8b15-f6cf8a70c841 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:45.413327 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fae0a2bc-7af5-48ad-8b15-f6cf8a70c841 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:45.414958 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fae0a2bc-7af5-48ad-8b15-f6cf8a70c841 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:45.417370 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fae0a2bc-7af5-48ad-8b15-f6cf8a70c841 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:45.418979 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fae0a2bc-7af5-48ad-8b15-f6cf8a70c841 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:45.421035 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fae0a2bc-7af5-48ad-8b15-f6cf8a70c841 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:45.507805 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-737cd5d0-ebe8-4c12-b354-e0fe0e9141c0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:45.520358 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-737cd5d0-ebe8-4c12-b354-e0fe0e9141c0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1292 microversion: 2.1 time: 0.177699 Oct 14 03:09:45.521005 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 146/291] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:45 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1292 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:45.581416 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-06ed98b3-718a-45bf-90db-2a5a109892e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:45.582317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-06ed98b3-718a-45bf-90db-2a5a109892e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:45.589383 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06ed98b3-718a-45bf-90db-2a5a109892e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:45.589875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06ed98b3-718a-45bf-90db-2a5a109892e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:45.590407 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06ed98b3-718a-45bf-90db-2a5a109892e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:45.591111 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06ed98b3-718a-45bf-90db-2a5a109892e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:45.591570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06ed98b3-718a-45bf-90db-2a5a109892e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:45.591998 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-06ed98b3-718a-45bf-90db-2a5a109892e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:45.776802 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fae0a2bc-7af5-48ad-8b15-f6cf8a70c841 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:45.785503 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fae0a2bc-7af5-48ad-8b15-f6cf8a70c841 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1723 microversion: 2.1 time: 0.391461 Oct 14 03:09:45.787586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 146/292] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:45 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1723 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:45.813100 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-06ed98b3-718a-45bf-90db-2a5a109892e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:45.821379 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-06ed98b3-718a-45bf-90db-2a5a109892e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:45.822831 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-06ed98b3-718a-45bf-90db-2a5a109892e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:45.824052 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-06ed98b3-718a-45bf-90db-2a5a109892e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.246727 Oct 14 03:09:45.824662 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 147/293] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:45 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:09:46.543689 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ab5ae6ac-e3c3-4272-977d-38fda3a3fb15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:46.544304 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ab5ae6ac-e3c3-4272-977d-38fda3a3fb15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:46.559682 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6ac-e3c3-4272-977d-38fda3a3fb15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:46.564193 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6ac-e3c3-4272-977d-38fda3a3fb15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:46.569046 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6ac-e3c3-4272-977d-38fda3a3fb15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:46.571470 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6ac-e3c3-4272-977d-38fda3a3fb15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:46.574770 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6ac-e3c3-4272-977d-38fda3a3fb15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:46.575489 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6ac-e3c3-4272-977d-38fda3a3fb15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:46.729887 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ab5ae6ac-e3c3-4272-977d-38fda3a3fb15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:46.742187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ab5ae6ac-e3c3-4272-977d-38fda3a3fb15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1310 microversion: 2.1 time: 0.202481 Oct 14 03:09:46.742777 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 147/294] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:46 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1310 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:46.809518 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-740499f8-f332-48ab-8714-14b4c0970817 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:46.811152 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-740499f8-f332-48ab-8714-14b4c0970817 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:46.819006 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-740499f8-f332-48ab-8714-14b4c0970817 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:46.819605 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-740499f8-f332-48ab-8714-14b4c0970817 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:46.820113 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-740499f8-f332-48ab-8714-14b4c0970817 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:46.820955 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-740499f8-f332-48ab-8714-14b4c0970817 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:46.821606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-740499f8-f332-48ab-8714-14b4c0970817 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:46.822188 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-740499f8-f332-48ab-8714-14b4c0970817 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:46.854693 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f2f7c568-4f59-4647-94b8-8e9395e14b3b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:46.855809 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f2f7c568-4f59-4647-94b8-8e9395e14b3b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:46.884909 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2f7c568-4f59-4647-94b8-8e9395e14b3b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:46.885618 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2f7c568-4f59-4647-94b8-8e9395e14b3b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:46.886454 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2f7c568-4f59-4647-94b8-8e9395e14b3b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:46.887730 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2f7c568-4f59-4647-94b8-8e9395e14b3b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:46.890478 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2f7c568-4f59-4647-94b8-8e9395e14b3b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:46.891302 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f2f7c568-4f59-4647-94b8-8e9395e14b3b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:47.312153 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-740499f8-f332-48ab-8714-14b4c0970817 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:47.313620 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-740499f8-f332-48ab-8714-14b4c0970817 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1723 microversion: 2.1 time: 0.508192 Oct 14 03:09:47.319784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 148/295] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:46 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1723 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:47.370391 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f2f7c568-4f59-4647-94b8-8e9395e14b3b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:47.385492 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f2f7c568-4f59-4647-94b8-8e9395e14b3b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:47.386970 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f2f7c568-4f59-4647-94b8-8e9395e14b3b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:47.388217 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f2f7c568-4f59-4647-94b8-8e9395e14b3b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.539782 Oct 14 03:09:47.388797 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 148/296] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:46 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:09:47.777249 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6bd749ed-94e2-4471-988e-acee4269dc6b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:47.777971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6bd749ed-94e2-4471-988e-acee4269dc6b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:47.798663 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6bd749ed-94e2-4471-988e-acee4269dc6b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:47.815524 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6bd749ed-94e2-4471-988e-acee4269dc6b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:47.817149 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6bd749ed-94e2-4471-988e-acee4269dc6b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:47.819129 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6bd749ed-94e2-4471-988e-acee4269dc6b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:47.822405 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6bd749ed-94e2-4471-988e-acee4269dc6b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:47.822869 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6bd749ed-94e2-4471-988e-acee4269dc6b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:47.959598 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6bd749ed-94e2-4471-988e-acee4269dc6b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:47.970866 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6bd749ed-94e2-4471-988e-acee4269dc6b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1298 microversion: 2.1 time: 0.203122 Oct 14 03:09:47.971398 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 149/297] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:47 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1298 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:48.343707 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-7b2325f3-0702-4303-a15e-2a20adb19fa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:48.344599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-7b2325f3-0702-4303-a15e-2a20adb19fa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:48.385854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7b2325f3-0702-4303-a15e-2a20adb19fa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:48.386741 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7b2325f3-0702-4303-a15e-2a20adb19fa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:48.387302 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7b2325f3-0702-4303-a15e-2a20adb19fa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:48.389335 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7b2325f3-0702-4303-a15e-2a20adb19fa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:48.390165 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7b2325f3-0702-4303-a15e-2a20adb19fa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:48.392890 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7b2325f3-0702-4303-a15e-2a20adb19fa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:48.421766 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b95bfa8f-307e-464b-bee5-79b4fe729ed9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:48.421766 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b95bfa8f-307e-464b-bee5-79b4fe729ed9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:48.432534 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b95bfa8f-307e-464b-bee5-79b4fe729ed9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:48.433042 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b95bfa8f-307e-464b-bee5-79b4fe729ed9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:48.433484 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b95bfa8f-307e-464b-bee5-79b4fe729ed9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:48.434526 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b95bfa8f-307e-464b-bee5-79b4fe729ed9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:48.434683 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b95bfa8f-307e-464b-bee5-79b4fe729ed9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:48.435106 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b95bfa8f-307e-464b-bee5-79b4fe729ed9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:48.962451 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-7b2325f3-0702-4303-a15e-2a20adb19fa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:48.980662 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-7b2325f3-0702-4303-a15e-2a20adb19fa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1723 microversion: 2.1 time: 0.634794 Oct 14 03:09:48.984954 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 149/298] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:48 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1723 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:48.987249 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b95bfa8f-307e-464b-bee5-79b4fe729ed9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:49.000104 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-4d575241-f75c-4e64-8efe-6f4bed0b6db6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:49.001219 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-4d575241-f75c-4e64-8efe-6f4bed0b6db6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:49.008177 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4d575241-f75c-4e64-8efe-6f4bed0b6db6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:49.009066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4d575241-f75c-4e64-8efe-6f4bed0b6db6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:49.009800 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4d575241-f75c-4e64-8efe-6f4bed0b6db6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:49.010858 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4d575241-f75c-4e64-8efe-6f4bed0b6db6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:49.011668 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4d575241-f75c-4e64-8efe-6f4bed0b6db6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:49.012439 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4d575241-f75c-4e64-8efe-6f4bed0b6db6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:49.028201 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b95bfa8f-307e-464b-bee5-79b4fe729ed9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:49.031473 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b95bfa8f-307e-464b-bee5-79b4fe729ed9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:49.047775 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b95bfa8f-307e-464b-bee5-79b4fe729ed9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1743 microversion: 2.20 time: 0.632187 Oct 14 03:09:49.052308 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 150/299] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:48 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1743 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:09:49.178251 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1890171191", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c246b20-9278-4e18-8b74-2f11a00777bc"}], "security_groups": [{"name": "tempest-securitygroup--965276251"}], "key_name": "tempest-keypair-908666610", "user_data": "}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:49.453727 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4d575241-f75c-4e64-8efe-6f4bed0b6db6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:49.463279 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-4d575241-f75c-4e64-8efe-6f4bed0b6db6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1365 microversion: 2.1 time: 0.471333 Oct 14 03:09:49.464087 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 150/300] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:48 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1365 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:49.469480 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.network.neutron [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] validate_networks() for [('1c246b20-9278-4e18-8b74-2f11a00777bc', None, None, None, None, None)] {{(pid=119302) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:09:49.755794 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-4dea10d0-e9b9-49e2-b6ce-f8cc79789f69 req-5195e2ce-f190-4b94-b35e-54274c3f6d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f165841c-8922-4baa-909d-daf6b2e6b924", "tag": "68b3e89f-dea9-471a-bb1c-93c3c17cade3"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:49.769242 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-4dea10d0-e9b9-49e2-b6ce-f8cc79789f69 req-5195e2ce-f190-4b94-b35e-54274c3f6d10 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:49.769741 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-4dea10d0-e9b9-49e2-b6ce-f8cc79789f69 req-5195e2ce-f190-4b94-b35e-54274c3f6d10 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:49.770245 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-4dea10d0-e9b9-49e2-b6ce-f8cc79789f69 req-5195e2ce-f190-4b94-b35e-54274c3f6d10 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:49.788979 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-4dea10d0-e9b9-49e2-b6ce-f8cc79789f69 req-5195e2ce-f190-4b94-b35e-54274c3f6d10 service nova] Creating event network-changed:68b3e89f-dea9-471a-bb1c-93c3c17cade3 for instance f165841c-8922-4baa-909d-daf6b2e6b924 on hv-cinder-80152 Oct 14 03:09:49.797858 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-4dea10d0-e9b9-49e2-b6ce-f8cc79789f69 req-5195e2ce-f190-4b94-b35e-54274c3f6d10 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047182 Oct 14 03:09:49.799086 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 151/301] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:50.003515 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8af95819-262b-4fd0-967c-4a2a50a3db81 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:50.004733 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8af95819-262b-4fd0-967c-4a2a50a3db81 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:50.017749 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8af95819-262b-4fd0-967c-4a2a50a3db81 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:50.018106 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8af95819-262b-4fd0-967c-4a2a50a3db81 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:50.018548 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8af95819-262b-4fd0-967c-4a2a50a3db81 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:50.021750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8af95819-262b-4fd0-967c-4a2a50a3db81 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:50.023889 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8af95819-262b-4fd0-967c-4a2a50a3db81 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:50.024555 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8af95819-262b-4fd0-967c-4a2a50a3db81 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:50.329341 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8af95819-262b-4fd0-967c-4a2a50a3db81 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:50.341041 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8af95819-262b-4fd0-967c-4a2a50a3db81 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1700 microversion: 2.1 time: 0.341365 Oct 14 03:09:50.341859 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 152/302] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:49 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1700 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:50.347954 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ca07e689-9679-4106-b811-61b9109ff7db tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:50.351840 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ca07e689-9679-4106-b811-61b9109ff7db tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:50.362928 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ca07e689-9679-4106-b811-61b9109ff7db tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:50.363695 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ca07e689-9679-4106-b811-61b9109ff7db tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:50.365505 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ca07e689-9679-4106-b811-61b9109ff7db tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:50.366129 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ca07e689-9679-4106-b811-61b9109ff7db tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:50.366748 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ca07e689-9679-4106-b811-61b9109ff7db tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:50.367731 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ca07e689-9679-4106-b811-61b9109ff7db tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:50.576626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Flavor limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:09:50.577957 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Image limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:09:50.579528 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Flavor pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:09:50.580199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Image pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:09:50.580900 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:09:50.593953 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:50.604209 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:50.604209 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:50.604209 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:50.604209 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:50.604705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:50.638051 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Getting quotas for project 61f89b8e68d14d3d96fa84ab1697fcea. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:09:50.646511 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Getting quotas for user dbf0723a0f3942d2b9b2554320878016 and project 61f89b8e68d14d3d96fa84ab1697fcea. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:09:50.672120 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Going to run 1 instances... {{(pid=119302) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:09:50.676033 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:09:50.806435 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ca07e689-9679-4106-b811-61b9109ff7db tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:50.819932 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ca07e689-9679-4106-b811-61b9109ff7db tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:50.824605 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ca07e689-9679-4106-b811-61b9109ff7db tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:50.842102 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ca07e689-9679-4106-b811-61b9109ff7db tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 0.498845 Oct 14 03:09:50.845121 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 153/303] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:50 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:50.857778 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0d532806-edb2-4c6b-ae5d-7d537062446f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:50.872967 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0d532806-edb2-4c6b-ae5d-7d537062446f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:50.873528 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0d532806-edb2-4c6b-ae5d-7d537062446f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:50.873917 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0d532806-edb2-4c6b-ae5d-7d537062446f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:50.877056 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f6236908-79e2-4f9e-8de5-b4345e0d3925 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.700490 Oct 14 03:09:50.886678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 151/304] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:09:49 2022] POST /compute/v2.1/servers => generated 408 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 14 03:09:50.902013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2d4e02e3-e1ec-425c-9111-32b010ad927c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:50.903384 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2d4e02e3-e1ec-425c-9111-32b010ad927c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:50.920926 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d4e02e3-e1ec-425c-9111-32b010ad927c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:50.922159 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d4e02e3-e1ec-425c-9111-32b010ad927c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:50.922771 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d4e02e3-e1ec-425c-9111-32b010ad927c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:50.924500 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d4e02e3-e1ec-425c-9111-32b010ad927c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:50.926904 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d4e02e3-e1ec-425c-9111-32b010ad927c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:50.927624 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d4e02e3-e1ec-425c-9111-32b010ad927c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:51.009522 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0d532806-edb2-4c6b-ae5d-7d537062446f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Going to try to start instance {{(pid=119301) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 14 03:09:51.225128 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0d532806-edb2-4c6b-ae5d-7d537062446f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "POST /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/action" status: 202 len: 0 microversion: 2.1 time: 0.377541 Oct 14 03:09:51.226034 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 154/305] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Oct 14 03:09:50 2022] POST /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:09:51.233120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3f2c4fbc-05a5-4941-b76f-d29b9561edd1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:51.235456 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3f2c4fbc-05a5-4941-b76f-d29b9561edd1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:51.389567 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2d4e02e3-e1ec-425c-9111-32b010ad927c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:51.389825 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3f2c4fbc-05a5-4941-b76f-d29b9561edd1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:51.397910 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2d4e02e3-e1ec-425c-9111-32b010ad927c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1365 microversion: 2.1 time: 0.509870 Oct 14 03:09:51.403041 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3f2c4fbc-05a5-4941-b76f-d29b9561edd1 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1245 microversion: 2.1 time: 0.175286 Oct 14 03:09:51.407147 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 155/306] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:51 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1245 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:51.416174 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 152/307] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:50 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1365 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:51.422655 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-6912da6f-d67a-4cd2-ace7-99bf1ab64315 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:51.423821 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-6912da6f-d67a-4cd2-ace7-99bf1ab64315 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:51.449642 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6912da6f-d67a-4cd2-ace7-99bf1ab64315 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:51.450358 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6912da6f-d67a-4cd2-ace7-99bf1ab64315 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:51.451015 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6912da6f-d67a-4cd2-ace7-99bf1ab64315 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:51.451891 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6912da6f-d67a-4cd2-ace7-99bf1ab64315 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:51.452667 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6912da6f-d67a-4cd2-ace7-99bf1ab64315 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:51.453522 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6912da6f-d67a-4cd2-ace7-99bf1ab64315 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:51.711008 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-6912da6f-d67a-4cd2-ace7-99bf1ab64315 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:51.734585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-6912da6f-d67a-4cd2-ace7-99bf1ab64315 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1709 microversion: 2.1 time: 0.329649 Oct 14 03:09:51.740188 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 156/308] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:51 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1709 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:51.876142 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-fe40019b-1089-4c02-843f-59bf052be259 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:51.876786 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-fe40019b-1089-4c02-843f-59bf052be259 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:51.889782 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe40019b-1089-4c02-843f-59bf052be259 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:51.890269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe40019b-1089-4c02-843f-59bf052be259 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:51.890717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe40019b-1089-4c02-843f-59bf052be259 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:51.891434 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe40019b-1089-4c02-843f-59bf052be259 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:51.891898 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe40019b-1089-4c02-843f-59bf052be259 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:51.892329 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe40019b-1089-4c02-843f-59bf052be259 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:52.172194 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-fe40019b-1089-4c02-843f-59bf052be259 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:52.183625 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-fe40019b-1089-4c02-843f-59bf052be259 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:52.185268 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-fe40019b-1089-4c02-843f-59bf052be259 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:52.189723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-fe40019b-1089-4c02-843f-59bf052be259 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 0.317641 Oct 14 03:09:52.191458 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 153/309] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:51 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:52.435215 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-af86813b-821b-4b51-834f-805a5193c985 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:52.437137 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-af86813b-821b-4b51-834f-805a5193c985 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:52.438268 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-6e756501-061e-4f43-919f-1fe0732947f6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:52.445705 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-6e756501-061e-4f43-919f-1fe0732947f6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:52.462573 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af86813b-821b-4b51-834f-805a5193c985 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:52.463077 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af86813b-821b-4b51-834f-805a5193c985 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:52.463519 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af86813b-821b-4b51-834f-805a5193c985 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:52.465990 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6e756501-061e-4f43-919f-1fe0732947f6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:52.466892 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af86813b-821b-4b51-834f-805a5193c985 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:52.467649 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6e756501-061e-4f43-919f-1fe0732947f6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:52.468324 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6e756501-061e-4f43-919f-1fe0732947f6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:52.469174 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af86813b-821b-4b51-834f-805a5193c985 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:52.471670 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6e756501-061e-4f43-919f-1fe0732947f6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:52.472249 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af86813b-821b-4b51-834f-805a5193c985 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:52.480171 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6e756501-061e-4f43-919f-1fe0732947f6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:52.480171 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6e756501-061e-4f43-919f-1fe0732947f6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:52.544360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=2 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:52.810095 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-af86813b-821b-4b51-834f-805a5193c985 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:52.842094 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-af86813b-821b-4b51-834f-805a5193c985 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1249 microversion: 2.1 time: 0.418756 Oct 14 03:09:52.846042 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 154/310] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:52 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1249 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:52.866556 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-21c8ac17-6258-4d3c-be46-566ecf07b091 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:52.867716 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-21c8ac17-6258-4d3c-be46-566ecf07b091 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:52.885272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-21c8ac17-6258-4d3c-be46-566ecf07b091 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:52.887739 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-21c8ac17-6258-4d3c-be46-566ecf07b091 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:52.890104 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-21c8ac17-6258-4d3c-be46-566ecf07b091 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:52.896315 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-21c8ac17-6258-4d3c-be46-566ecf07b091 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:52.901093 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-21c8ac17-6258-4d3c-be46-566ecf07b091 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:52.902788 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-21c8ac17-6258-4d3c-be46-566ecf07b091 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:53.318250 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-6e756501-061e-4f43-919f-1fe0732947f6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:53.327366 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:53.335241 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-6e756501-061e-4f43-919f-1fe0732947f6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1365 microversion: 2.1 time: 0.914992 Oct 14 03:09:53.338256 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 157/311] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:52 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1365 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:53.350503 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-59250296-5893-411e-9025-0e7ccf79e918 req-6b12e973-bca2-4a2c-aba7-0dd28b4ce140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866d9750-81fa-4eba-a3b7-b1c1182ed24d", "name": "network-vif-plugged", "status": "completed", "tag": "846e0443-12a3-4f37-a28b-a559f43fd6b4"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:53.377049 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-59250296-5893-411e-9025-0e7ccf79e918 req-6b12e973-bca2-4a2c-aba7-0dd28b4ce140 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:53.385596 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-59250296-5893-411e-9025-0e7ccf79e918 req-6b12e973-bca2-4a2c-aba7-0dd28b4ce140 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:53.385596 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-59250296-5893-411e-9025-0e7ccf79e918 req-6b12e973-bca2-4a2c-aba7-0dd28b4ce140 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:53.402089 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-59250296-5893-411e-9025-0e7ccf79e918 req-6b12e973-bca2-4a2c-aba7-0dd28b4ce140 service nova] Creating event network-vif-plugged:846e0443-12a3-4f37-a28b-a559f43fd6b4 for instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d on hv-cinder-80152 Oct 14 03:09:53.408553 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-59250296-5893-411e-9025-0e7ccf79e918 req-6b12e973-bca2-4a2c-aba7-0dd28b4ce140 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068389 Oct 14 03:09:53.410246 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 158/312] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:53.420267 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1c188a27-fccf-4ad8-baaf-27f15e383263 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:53.420267 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1c188a27-fccf-4ad8-baaf-27f15e383263 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:53.426870 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1c188a27-fccf-4ad8-baaf-27f15e383263 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:53.427922 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1c188a27-fccf-4ad8-baaf-27f15e383263 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:53.428617 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1c188a27-fccf-4ad8-baaf-27f15e383263 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:53.429626 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1c188a27-fccf-4ad8-baaf-27f15e383263 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:53.430311 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1c188a27-fccf-4ad8-baaf-27f15e383263 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:53.430967 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1c188a27-fccf-4ad8-baaf-27f15e383263 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:53.434932 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-21c8ac17-6258-4d3c-be46-566ecf07b091 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:53.457001 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-21c8ac17-6258-4d3c-be46-566ecf07b091 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1709 microversion: 2.1 time: 0.608465 Oct 14 03:09:53.464133 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 155/313] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:52 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1709 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:53.651023 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1c188a27-fccf-4ad8-baaf-27f15e383263 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:53.685052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1c188a27-fccf-4ad8-baaf-27f15e383263 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:53.686522 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1c188a27-fccf-4ad8-baaf-27f15e383263 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:53.687703 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1c188a27-fccf-4ad8-baaf-27f15e383263 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 0.275954 Oct 14 03:09:53.688271 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 159/314] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:53 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:53.868558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a30ede02-7666-4373-85a2-f60662e791e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:53.876915 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-a30ede02-7666-4373-85a2-f60662e791e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:53.890726 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a30ede02-7666-4373-85a2-f60662e791e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:53.896791 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a30ede02-7666-4373-85a2-f60662e791e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:53.896791 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a30ede02-7666-4373-85a2-f60662e791e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:53.896791 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a30ede02-7666-4373-85a2-f60662e791e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:53.896791 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a30ede02-7666-4373-85a2-f60662e791e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:53.898787 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a30ede02-7666-4373-85a2-f60662e791e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:54.104728 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a30ede02-7666-4373-85a2-f60662e791e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:54.125714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-a30ede02-7666-4373-85a2-f60662e791e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1297 microversion: 2.1 time: 0.263765 Oct 14 03:09:54.126700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 156/315] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:53 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1297 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:54.361944 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-61634519-ab36-47a1-872a-d7fd7fdff480 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:54.362564 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-61634519-ab36-47a1-872a-d7fd7fdff480 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:54.365168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:54.381697 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-61634519-ab36-47a1-872a-d7fd7fdff480 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:54.383466 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-61634519-ab36-47a1-872a-d7fd7fdff480 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:54.386731 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-61634519-ab36-47a1-872a-d7fd7fdff480 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:54.387819 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-61634519-ab36-47a1-872a-d7fd7fdff480 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:54.388471 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-61634519-ab36-47a1-872a-d7fd7fdff480 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:54.389876 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-61634519-ab36-47a1-872a-d7fd7fdff480 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:54.491777 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-de02fe55-51f5-46d1-be9e-73bdf04907ac tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:54.492326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-de02fe55-51f5-46d1-be9e-73bdf04907ac tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:54.503728 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-de02fe55-51f5-46d1-be9e-73bdf04907ac tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:54.504225 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-de02fe55-51f5-46d1-be9e-73bdf04907ac tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:54.512351 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-de02fe55-51f5-46d1-be9e-73bdf04907ac tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:54.512351 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-de02fe55-51f5-46d1-be9e-73bdf04907ac tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:54.512351 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-de02fe55-51f5-46d1-be9e-73bdf04907ac tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:54.512351 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-de02fe55-51f5-46d1-be9e-73bdf04907ac tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:55.241302 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-de02fe55-51f5-46d1-be9e-73bdf04907ac tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:55.261349 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-de02fe55-51f5-46d1-be9e-73bdf04907ac tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1709 microversion: 2.1 time: 0.770292 Oct 14 03:09:55.269037 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 157/316] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:54 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1709 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:55.281241 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b547e565-fac6-47b9-a057-5e846bf1ded6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:55.282519 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b547e565-fac6-47b9-a057-5e846bf1ded6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:55.308424 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b547e565-fac6-47b9-a057-5e846bf1ded6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:55.310545 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b547e565-fac6-47b9-a057-5e846bf1ded6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:55.311560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b547e565-fac6-47b9-a057-5e846bf1ded6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:55.313742 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b547e565-fac6-47b9-a057-5e846bf1ded6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:55.315438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b547e565-fac6-47b9-a057-5e846bf1ded6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:55.318057 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b547e565-fac6-47b9-a057-5e846bf1ded6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:55.446076 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-61634519-ab36-47a1-872a-d7fd7fdff480 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:55.503518 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-61634519-ab36-47a1-872a-d7fd7fdff480 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1365 microversion: 2.1 time: 1.143123 Oct 14 03:09:55.508821 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 160/317] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:54 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1365 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:55.545865 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b617365d-29de-490b-aa5f-3df8e6b8cb55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:55.545865 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b617365d-29de-490b-aa5f-3df8e6b8cb55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:55.554551 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b617365d-29de-490b-aa5f-3df8e6b8cb55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:55.555072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b547e565-fac6-47b9-a057-5e846bf1ded6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:55.555601 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b617365d-29de-490b-aa5f-3df8e6b8cb55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:55.556597 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b617365d-29de-490b-aa5f-3df8e6b8cb55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:55.557715 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b617365d-29de-490b-aa5f-3df8e6b8cb55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:55.560953 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b617365d-29de-490b-aa5f-3df8e6b8cb55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:55.561930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b617365d-29de-490b-aa5f-3df8e6b8cb55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:55.564546 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b547e565-fac6-47b9-a057-5e846bf1ded6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:55.567198 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b547e565-fac6-47b9-a057-5e846bf1ded6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:55.569271 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b547e565-fac6-47b9-a057-5e846bf1ded6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 0.298609 Oct 14 03:09:55.570285 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 158/318] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:55 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:55.708022 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b617365d-29de-490b-aa5f-3df8e6b8cb55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:55.717175 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b617365d-29de-490b-aa5f-3df8e6b8cb55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1305 microversion: 2.1 time: 0.204461 Oct 14 03:09:55.718004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 161/319] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:55 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1305 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:56.292416 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2f9c2f11-848f-48f6-abf7-adc888f7f4b1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:56.293014 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2f9c2f11-848f-48f6-abf7-adc888f7f4b1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:56.305923 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f9c2f11-848f-48f6-abf7-adc888f7f4b1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:56.324827 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f9c2f11-848f-48f6-abf7-adc888f7f4b1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:56.329484 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f9c2f11-848f-48f6-abf7-adc888f7f4b1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:56.332685 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f9c2f11-848f-48f6-abf7-adc888f7f4b1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:56.333745 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f9c2f11-848f-48f6-abf7-adc888f7f4b1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:56.334852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f9c2f11-848f-48f6-abf7-adc888f7f4b1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:56.531259 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-be1d3063-6400-49c9-8366-86742d54d609 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:56.531879 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-be1d3063-6400-49c9-8366-86742d54d609 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:56.558483 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-be1d3063-6400-49c9-8366-86742d54d609 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:56.559043 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-be1d3063-6400-49c9-8366-86742d54d609 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:56.559501 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-be1d3063-6400-49c9-8366-86742d54d609 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:56.560250 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-be1d3063-6400-49c9-8366-86742d54d609 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:56.560748 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-be1d3063-6400-49c9-8366-86742d54d609 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:56.561180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-be1d3063-6400-49c9-8366-86742d54d609 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:56.835539 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2f9c2f11-848f-48f6-abf7-adc888f7f4b1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:56.850464 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2f9c2f11-848f-48f6-abf7-adc888f7f4b1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1713 microversion: 2.1 time: 0.565423 Oct 14 03:09:56.856613 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 159/320] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:56 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1713 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:56.866747 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-5de1b811-7e49-4259-8895-2012534ab60c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:56.869227 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-5de1b811-7e49-4259-8895-2012534ab60c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:56.922335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5de1b811-7e49-4259-8895-2012534ab60c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:56.922996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5de1b811-7e49-4259-8895-2012534ab60c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:56.926051 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5de1b811-7e49-4259-8895-2012534ab60c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:56.929166 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5de1b811-7e49-4259-8895-2012534ab60c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:56.931711 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5de1b811-7e49-4259-8895-2012534ab60c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:56.939769 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5de1b811-7e49-4259-8895-2012534ab60c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:57.032168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-be1d3063-6400-49c9-8366-86742d54d609 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:57.066120 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=100 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:57.076374 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-be1d3063-6400-49c9-8366-86742d54d609 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1365 microversion: 2.1 time: 0.548740 Oct 14 03:09:57.139199 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 162/321] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:56 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1365 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:57.154767 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e904198c-7255-4111-9c29-1162421757c9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:57.157956 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e904198c-7255-4111-9c29-1162421757c9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:57.175212 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e904198c-7255-4111-9c29-1162421757c9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:57.179854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e904198c-7255-4111-9c29-1162421757c9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:57.180729 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e904198c-7255-4111-9c29-1162421757c9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:57.182290 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e904198c-7255-4111-9c29-1162421757c9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:57.187629 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e904198c-7255-4111-9c29-1162421757c9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:57.192329 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e904198c-7255-4111-9c29-1162421757c9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:57.400964 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5de1b811-7e49-4259-8895-2012534ab60c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:57.415614 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5de1b811-7e49-4259-8895-2012534ab60c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:57.419237 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5de1b811-7e49-4259-8895-2012534ab60c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:57.421025 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-5de1b811-7e49-4259-8895-2012534ab60c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 0.563222 Oct 14 03:09:57.422707 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 160/322] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:56 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:57.435694 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-5708c33c-8682-44ef-9608-e11a1b474613 req-0155ac92-b461-419e-9403-e774bdb309d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f165841c-8922-4baa-909d-daf6b2e6b924", "name": "network-vif-plugged", "status": "completed", "tag": "68b3e89f-dea9-471a-bb1c-93c3c17cade3"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:57.447408 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-5708c33c-8682-44ef-9608-e11a1b474613 req-0155ac92-b461-419e-9403-e774bdb309d9 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:57.448246 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-5708c33c-8682-44ef-9608-e11a1b474613 req-0155ac92-b461-419e-9403-e774bdb309d9 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:57.448957 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-5708c33c-8682-44ef-9608-e11a1b474613 req-0155ac92-b461-419e-9403-e774bdb309d9 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:57.465771 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-5708c33c-8682-44ef-9608-e11a1b474613 req-0155ac92-b461-419e-9403-e774bdb309d9 service nova] Creating event network-vif-plugged:68b3e89f-dea9-471a-bb1c-93c3c17cade3 for instance f165841c-8922-4baa-909d-daf6b2e6b924 on hv-cinder-80152 Oct 14 03:09:57.471522 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-5708c33c-8682-44ef-9608-e11a1b474613 req-0155ac92-b461-419e-9403-e774bdb309d9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039732 Oct 14 03:09:57.477867 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 161/323] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:57.525977 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-e904198c-7255-4111-9c29-1162421757c9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:57.547353 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e904198c-7255-4111-9c29-1162421757c9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.396427 Oct 14 03:09:57.548919 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 163/324] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:57 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:58.149347 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-95aa1536-026b-49b2-805c-a1a70ef33ed3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:58.150421 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-95aa1536-026b-49b2-805c-a1a70ef33ed3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:58.163379 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-95aa1536-026b-49b2-805c-a1a70ef33ed3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:58.175211 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-95aa1536-026b-49b2-805c-a1a70ef33ed3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:58.175211 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-95aa1536-026b-49b2-805c-a1a70ef33ed3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:58.175211 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-95aa1536-026b-49b2-805c-a1a70ef33ed3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:58.175211 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-95aa1536-026b-49b2-805c-a1a70ef33ed3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:58.175829 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-95aa1536-026b-49b2-805c-a1a70ef33ed3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:58.464200 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ef8f9d63-460f-479b-8532-c6ffcebb9d35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:58.465164 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ef8f9d63-460f-479b-8532-c6ffcebb9d35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:58.494405 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-95aa1536-026b-49b2-805c-a1a70ef33ed3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:58.495626 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ef8f9d63-460f-479b-8532-c6ffcebb9d35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:58.496337 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ef8f9d63-460f-479b-8532-c6ffcebb9d35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:58.496932 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ef8f9d63-460f-479b-8532-c6ffcebb9d35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:58.500202 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ef8f9d63-460f-479b-8532-c6ffcebb9d35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:58.502325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ef8f9d63-460f-479b-8532-c6ffcebb9d35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:58.503439 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ef8f9d63-460f-479b-8532-c6ffcebb9d35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:58.506031 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-95aa1536-026b-49b2-805c-a1a70ef33ed3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1365 microversion: 2.1 time: 0.362161 Oct 14 03:09:58.506031 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 162/325] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:58 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1365 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:58.575137 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6264e6ba-38c6-4e9f-8197-dd102f5994f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:58.576005 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6264e6ba-38c6-4e9f-8197-dd102f5994f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:58.583936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6264e6ba-38c6-4e9f-8197-dd102f5994f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:58.586271 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6264e6ba-38c6-4e9f-8197-dd102f5994f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:58.588484 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6264e6ba-38c6-4e9f-8197-dd102f5994f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:58.589396 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6264e6ba-38c6-4e9f-8197-dd102f5994f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:58.590811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6264e6ba-38c6-4e9f-8197-dd102f5994f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:58.592765 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6264e6ba-38c6-4e9f-8197-dd102f5994f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:58.890276 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ef8f9d63-460f-479b-8532-c6ffcebb9d35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:58.902392 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6264e6ba-38c6-4e9f-8197-dd102f5994f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:58.906149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ef8f9d63-460f-479b-8532-c6ffcebb9d35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:58.908223 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ef8f9d63-460f-479b-8532-c6ffcebb9d35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:58.909831 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ef8f9d63-460f-479b-8532-c6ffcebb9d35 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 0.451432 Oct 14 03:09:58.910270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6264e6ba-38c6-4e9f-8197-dd102f5994f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.338964 Oct 14 03:09:58.912581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 164/326] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:58 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:09:58.914912 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 163/327] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:58 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:59.296169 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-4495c0b8-b9a1-4b74-9335-3b42d57e3881 req-903d79e4-ff20-4527-9fe0-99288634de59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ae6b50-1d01-420e-ab83-6c856e0b35d4", "tag": "f66ba8f5-3869-4069-a4dc-7c7a64eb44d9"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:59.312767 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-4495c0b8-b9a1-4b74-9335-3b42d57e3881 req-903d79e4-ff20-4527-9fe0-99288634de59 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:59.314040 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-4495c0b8-b9a1-4b74-9335-3b42d57e3881 req-903d79e4-ff20-4527-9fe0-99288634de59 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:59.316674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-4495c0b8-b9a1-4b74-9335-3b42d57e3881 req-903d79e4-ff20-4527-9fe0-99288634de59 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:59.344562 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-4495c0b8-b9a1-4b74-9335-3b42d57e3881 req-903d79e4-ff20-4527-9fe0-99288634de59 service nova] Creating event network-changed:f66ba8f5-3869-4069-a4dc-7c7a64eb44d9 for instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 on hv-cinder-80152 Oct 14 03:09:59.365557 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-4495c0b8-b9a1-4b74-9335-3b42d57e3881 req-903d79e4-ff20-4527-9fe0-99288634de59 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071512 Oct 14 03:09:59.367110 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 165/328] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:59.528218 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6108cef7-fc71-4c3c-b857-2129de098150 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:59.528945 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6108cef7-fc71-4c3c-b857-2129de098150 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:59.547910 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6108cef7-fc71-4c3c-b857-2129de098150 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:59.548432 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6108cef7-fc71-4c3c-b857-2129de098150 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:59.548873 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6108cef7-fc71-4c3c-b857-2129de098150 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:59.553382 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6108cef7-fc71-4c3c-b857-2129de098150 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:59.553862 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6108cef7-fc71-4c3c-b857-2129de098150 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:59.554300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6108cef7-fc71-4c3c-b857-2129de098150 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:59.938265 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-05b7b40b-6c8e-4b37-a52f-97b1de2a5cd1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:59.942665 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-05b7b40b-6c8e-4b37-a52f-97b1de2a5cd1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:59.958606 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05b7b40b-6c8e-4b37-a52f-97b1de2a5cd1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:59.959143 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05b7b40b-6c8e-4b37-a52f-97b1de2a5cd1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:59.959589 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05b7b40b-6c8e-4b37-a52f-97b1de2a5cd1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:59.961496 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05b7b40b-6c8e-4b37-a52f-97b1de2a5cd1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:59.961963 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05b7b40b-6c8e-4b37-a52f-97b1de2a5cd1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:59.962395 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05b7b40b-6c8e-4b37-a52f-97b1de2a5cd1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:00.107992 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6108cef7-fc71-4c3c-b857-2129de098150 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:00.198128 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6108cef7-fc71-4c3c-b857-2129de098150 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1365 microversion: 2.1 time: 0.603321 Oct 14 03:10:00.198128 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 164/329] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:59 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1365 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:00.198128 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-83fa31bc-4ec0-4a15-8261-d6143c315297 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:00.198128 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-83fa31bc-4ec0-4a15-8261-d6143c315297 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:00.214060 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-83fa31bc-4ec0-4a15-8261-d6143c315297 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:00.221851 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-83fa31bc-4ec0-4a15-8261-d6143c315297 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:00.225578 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-83fa31bc-4ec0-4a15-8261-d6143c315297 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:00.228457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-83fa31bc-4ec0-4a15-8261-d6143c315297 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:00.231430 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-83fa31bc-4ec0-4a15-8261-d6143c315297 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:00.255620 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-83fa31bc-4ec0-4a15-8261-d6143c315297 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:00.614012 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=2 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:00.661065 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=8 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:01.007785 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-83fa31bc-4ec0-4a15-8261-d6143c315297 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:01.029847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-83fa31bc-4ec0-4a15-8261-d6143c315297 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.900066 Oct 14 03:10:01.032051 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 165/330] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:00 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:01.122284 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-05b7b40b-6c8e-4b37-a52f-97b1de2a5cd1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:01.143218 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-05b7b40b-6c8e-4b37-a52f-97b1de2a5cd1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:01.154395 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-05b7b40b-6c8e-4b37-a52f-97b1de2a5cd1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:01.157951 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-05b7b40b-6c8e-4b37-a52f-97b1de2a5cd1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 1.222431 Oct 14 03:10:01.157951 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 166/331] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:59 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:01.174993 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-5ffe8dc8-e556-4e1d-a1bf-835577db76eb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:01.176879 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-5ffe8dc8-e556-4e1d-a1bf-835577db76eb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:01.186409 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5ffe8dc8-e556-4e1d-a1bf-835577db76eb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:01.194169 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5ffe8dc8-e556-4e1d-a1bf-835577db76eb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:01.194996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5ffe8dc8-e556-4e1d-a1bf-835577db76eb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:01.195970 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5ffe8dc8-e556-4e1d-a1bf-835577db76eb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:01.198201 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5ffe8dc8-e556-4e1d-a1bf-835577db76eb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:01.203211 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5ffe8dc8-e556-4e1d-a1bf-835577db76eb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:01.617327 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5ffe8dc8-e556-4e1d-a1bf-835577db76eb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:01.625807 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-5ffe8dc8-e556-4e1d-a1bf-835577db76eb tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1555 microversion: 2.1 time: 0.455988 Oct 14 03:10:01.628924 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 166/332] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:01 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1555 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:01.658065 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1cc1fd5b-87a3-49b7-8932-485244fcc6ba tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:01.658749 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1cc1fd5b-87a3-49b7-8932-485244fcc6ba tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:01.671995 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=18 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:01.688611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1cc1fd5b-87a3-49b7-8932-485244fcc6ba tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:01.690204 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1cc1fd5b-87a3-49b7-8932-485244fcc6ba tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:01.691266 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1cc1fd5b-87a3-49b7-8932-485244fcc6ba tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:01.692317 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1cc1fd5b-87a3-49b7-8932-485244fcc6ba tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:01.693075 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1cc1fd5b-87a3-49b7-8932-485244fcc6ba tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:01.694689 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1cc1fd5b-87a3-49b7-8932-485244fcc6ba tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:01.989233 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1cc1fd5b-87a3-49b7-8932-485244fcc6ba tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.329422 Oct 14 03:10:01.989233 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 167/333] 10.222.0.13 () {58 vars in 1275 bytes} [Fri Oct 14 03:10:01 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924/os-interface => generated 284 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:02.056604 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-654eff9c-2660-4d82-aae7-5e00bf87d7d2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:02.057597 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-654eff9c-2660-4d82-aae7-5e00bf87d7d2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:02.070081 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-654eff9c-2660-4d82-aae7-5e00bf87d7d2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:02.070932 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-654eff9c-2660-4d82-aae7-5e00bf87d7d2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:02.071550 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-654eff9c-2660-4d82-aae7-5e00bf87d7d2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:02.072457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-654eff9c-2660-4d82-aae7-5e00bf87d7d2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:02.073042 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-654eff9c-2660-4d82-aae7-5e00bf87d7d2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:02.073714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-654eff9c-2660-4d82-aae7-5e00bf87d7d2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:02.187428 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-37798573-d7ed-4488-917f-945af170b55a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:02.188225 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-37798573-d7ed-4488-917f-945af170b55a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:02.198048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37798573-d7ed-4488-917f-945af170b55a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:02.201146 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37798573-d7ed-4488-917f-945af170b55a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:02.201732 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37798573-d7ed-4488-917f-945af170b55a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:02.205767 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37798573-d7ed-4488-917f-945af170b55a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:02.206553 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37798573-d7ed-4488-917f-945af170b55a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:02.207800 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37798573-d7ed-4488-917f-945af170b55a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:02.331646 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-654eff9c-2660-4d82-aae7-5e00bf87d7d2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:02.345489 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-654eff9c-2660-4d82-aae7-5e00bf87d7d2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.293108 Oct 14 03:10:02.346678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 167/334] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:02 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:02.429776 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-37798573-d7ed-4488-917f-945af170b55a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:02.439997 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-37798573-d7ed-4488-917f-945af170b55a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:02.447462 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-37798573-d7ed-4488-917f-945af170b55a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:02.450427 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-37798573-d7ed-4488-917f-945af170b55a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 0.267339 Oct 14 03:10:02.471081 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 168/335] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:02 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:03.369275 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e8747c16-36b7-47d0-93cc-14e6ffb466fc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:03.370870 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e8747c16-36b7-47d0-93cc-14e6ffb466fc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:03.386935 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e8747c16-36b7-47d0-93cc-14e6ffb466fc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:03.386935 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e8747c16-36b7-47d0-93cc-14e6ffb466fc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:03.386935 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e8747c16-36b7-47d0-93cc-14e6ffb466fc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:03.386935 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e8747c16-36b7-47d0-93cc-14e6ffb466fc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:03.387436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e8747c16-36b7-47d0-93cc-14e6ffb466fc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:03.387436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e8747c16-36b7-47d0-93cc-14e6ffb466fc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:03.507303 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-79059931-06e9-45c8-b8b1-9be77e147130 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:03.508283 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-79059931-06e9-45c8-b8b1-9be77e147130 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:03.526234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-79059931-06e9-45c8-b8b1-9be77e147130 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:03.527264 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-79059931-06e9-45c8-b8b1-9be77e147130 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:03.530105 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-79059931-06e9-45c8-b8b1-9be77e147130 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:03.536379 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-79059931-06e9-45c8-b8b1-9be77e147130 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:03.537295 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-79059931-06e9-45c8-b8b1-9be77e147130 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:03.538716 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-79059931-06e9-45c8-b8b1-9be77e147130 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:03.640807 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e8747c16-36b7-47d0-93cc-14e6ffb466fc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:03.651386 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e8747c16-36b7-47d0-93cc-14e6ffb466fc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.286746 Oct 14 03:10:03.668675 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 168/336] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:03 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:03.675900 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-ec806401-a518-4582-a18a-b226a2a29c7f req-03b052ac-bd2f-492a-9972-9c137246f9ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f165841c-8922-4baa-909d-daf6b2e6b924", "tag": "68b3e89f-dea9-471a-bb1c-93c3c17cade3"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:03.686182 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-ec806401-a518-4582-a18a-b226a2a29c7f req-03b052ac-bd2f-492a-9972-9c137246f9ba service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:03.686925 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-ec806401-a518-4582-a18a-b226a2a29c7f req-03b052ac-bd2f-492a-9972-9c137246f9ba service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:03.687501 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-ec806401-a518-4582-a18a-b226a2a29c7f req-03b052ac-bd2f-492a-9972-9c137246f9ba service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:03.715205 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-ec806401-a518-4582-a18a-b226a2a29c7f req-03b052ac-bd2f-492a-9972-9c137246f9ba service nova] Creating event network-changed:68b3e89f-dea9-471a-bb1c-93c3c17cade3 for instance f165841c-8922-4baa-909d-daf6b2e6b924 on hv-cinder-80152 Oct 14 03:10:03.727417 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-ec806401-a518-4582-a18a-b226a2a29c7f req-03b052ac-bd2f-492a-9972-9c137246f9ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057230 Oct 14 03:10:03.728311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 169/337] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:03.965841 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-79059931-06e9-45c8-b8b1-9be77e147130 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:03.980452 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-79059931-06e9-45c8-b8b1-9be77e147130 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:03.994997 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-79059931-06e9-45c8-b8b1-9be77e147130 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:04.004861 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-79059931-06e9-45c8-b8b1-9be77e147130 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 0.503446 Oct 14 03:10:04.029473 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 169/338] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:03 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:04.678083 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2d974b51-c7b1-4260-a5c1-aaa75ede1388 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:04.678591 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2d974b51-c7b1-4260-a5c1-aaa75ede1388 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:04.700994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d974b51-c7b1-4260-a5c1-aaa75ede1388 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:04.701700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d974b51-c7b1-4260-a5c1-aaa75ede1388 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:04.702297 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d974b51-c7b1-4260-a5c1-aaa75ede1388 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:04.713466 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d974b51-c7b1-4260-a5c1-aaa75ede1388 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:04.714234 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d974b51-c7b1-4260-a5c1-aaa75ede1388 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:04.714833 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d974b51-c7b1-4260-a5c1-aaa75ede1388 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:05.020151 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2d974b51-c7b1-4260-a5c1-aaa75ede1388 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:05.029757 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2d974b51-c7b1-4260-a5c1-aaa75ede1388 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.357952 Oct 14 03:10:05.040846 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c4f42526-b18e-4989-a4d0-743ef3510c45 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:05.040846 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c4f42526-b18e-4989-a4d0-743ef3510c45 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:05.041700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 170/339] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:04 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:05.054468 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c4f42526-b18e-4989-a4d0-743ef3510c45 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:05.054468 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c4f42526-b18e-4989-a4d0-743ef3510c45 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:05.054468 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c4f42526-b18e-4989-a4d0-743ef3510c45 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:05.054468 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c4f42526-b18e-4989-a4d0-743ef3510c45 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:05.054785 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c4f42526-b18e-4989-a4d0-743ef3510c45 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:05.054785 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c4f42526-b18e-4989-a4d0-743ef3510c45 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:05.311368 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c4f42526-b18e-4989-a4d0-743ef3510c45 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:05.320509 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c4f42526-b18e-4989-a4d0-743ef3510c45 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:05.321966 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c4f42526-b18e-4989-a4d0-743ef3510c45 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:05.323162 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c4f42526-b18e-4989-a4d0-743ef3510c45 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 0.290129 Oct 14 03:10:05.336049 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 170/340] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:05 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:06.058393 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6bba1204-2aa3-4b65-88c1-52f909ea3f4a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:06.058982 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6bba1204-2aa3-4b65-88c1-52f909ea3f4a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:06.062521 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:06.081480 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6bba1204-2aa3-4b65-88c1-52f909ea3f4a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.084971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6bba1204-2aa3-4b65-88c1-52f909ea3f4a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.084971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6bba1204-2aa3-4b65-88c1-52f909ea3f4a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.084971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6bba1204-2aa3-4b65-88c1-52f909ea3f4a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.084971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6bba1204-2aa3-4b65-88c1-52f909ea3f4a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.085354 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6bba1204-2aa3-4b65-88c1-52f909ea3f4a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.353667 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-4abca2fc-a4c7-497a-afc1-6b2d35a00aaf tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:06.354441 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-4abca2fc-a4c7-497a-afc1-6b2d35a00aaf tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:06.371808 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4abca2fc-a4c7-497a-afc1-6b2d35a00aaf tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.373327 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4abca2fc-a4c7-497a-afc1-6b2d35a00aaf tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.374101 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4abca2fc-a4c7-497a-afc1-6b2d35a00aaf tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.381955 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4abca2fc-a4c7-497a-afc1-6b2d35a00aaf tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.382789 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4abca2fc-a4c7-497a-afc1-6b2d35a00aaf tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.384492 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4abca2fc-a4c7-497a-afc1-6b2d35a00aaf tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.403424 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6bba1204-2aa3-4b65-88c1-52f909ea3f4a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:06.411690 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6bba1204-2aa3-4b65-88c1-52f909ea3f4a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.357090 Oct 14 03:10:06.412271 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 171/341] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:06 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:06.659178 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4abca2fc-a4c7-497a-afc1-6b2d35a00aaf tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:06.671118 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4abca2fc-a4c7-497a-afc1-6b2d35a00aaf tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:06.672943 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4abca2fc-a4c7-497a-afc1-6b2d35a00aaf tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:06.675539 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-4abca2fc-a4c7-497a-afc1-6b2d35a00aaf tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 0.325941 Oct 14 03:10:06.678357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 171/342] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:06 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:07.442477 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-04422311-a9b4-4204-b919-7f4dcb474a5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:07.443038 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-04422311-a9b4-4204-b919-7f4dcb474a5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:07.449442 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-04422311-a9b4-4204-b919-7f4dcb474a5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.449933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-04422311-a9b4-4204-b919-7f4dcb474a5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.450387 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-04422311-a9b4-4204-b919-7f4dcb474a5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.451078 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-04422311-a9b4-4204-b919-7f4dcb474a5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.451543 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-04422311-a9b4-4204-b919-7f4dcb474a5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.451976 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-04422311-a9b4-4204-b919-7f4dcb474a5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.616444 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-04422311-a9b4-4204-b919-7f4dcb474a5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:07.616679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-04422311-a9b4-4204-b919-7f4dcb474a5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.177954 Oct 14 03:10:07.617561 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 172/343] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:07 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:07.705574 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c6831ac7-6018-4935-921b-f52a64e0e5cc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:07.706379 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c6831ac7-6018-4935-921b-f52a64e0e5cc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:07.713448 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c6831ac7-6018-4935-921b-f52a64e0e5cc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.713940 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c6831ac7-6018-4935-921b-f52a64e0e5cc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.714367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c6831ac7-6018-4935-921b-f52a64e0e5cc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.715077 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c6831ac7-6018-4935-921b-f52a64e0e5cc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.715533 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c6831ac7-6018-4935-921b-f52a64e0e5cc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.716147 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c6831ac7-6018-4935-921b-f52a64e0e5cc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.863002 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c6831ac7-6018-4935-921b-f52a64e0e5cc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:07.871025 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c6831ac7-6018-4935-921b-f52a64e0e5cc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:07.872509 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c6831ac7-6018-4935-921b-f52a64e0e5cc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:07.873669 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c6831ac7-6018-4935-921b-f52a64e0e5cc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 0.172448 Oct 14 03:10:07.874223 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 172/344] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:07 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:08.639285 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-5c28297f-40ee-491e-a5ec-040302de1bbf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:08.640743 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-5c28297f-40ee-491e-a5ec-040302de1bbf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:08.659213 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5c28297f-40ee-491e-a5ec-040302de1bbf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:08.670429 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5c28297f-40ee-491e-a5ec-040302de1bbf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:08.671215 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5c28297f-40ee-491e-a5ec-040302de1bbf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:08.672006 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5c28297f-40ee-491e-a5ec-040302de1bbf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:08.678589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5c28297f-40ee-491e-a5ec-040302de1bbf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:08.678589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5c28297f-40ee-491e-a5ec-040302de1bbf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:08.899122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-115b9d8a-9883-499d-bbcb-9e782a20131b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:08.899702 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-115b9d8a-9883-499d-bbcb-9e782a20131b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:08.907968 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-115b9d8a-9883-499d-bbcb-9e782a20131b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:08.914055 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-115b9d8a-9883-499d-bbcb-9e782a20131b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:08.917041 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-115b9d8a-9883-499d-bbcb-9e782a20131b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:08.918024 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-115b9d8a-9883-499d-bbcb-9e782a20131b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:08.922977 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-115b9d8a-9883-499d-bbcb-9e782a20131b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:08.927381 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-115b9d8a-9883-499d-bbcb-9e782a20131b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:08.942181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5c28297f-40ee-491e-a5ec-040302de1bbf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:08.953114 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-5c28297f-40ee-491e-a5ec-040302de1bbf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.317787 Oct 14 03:10:08.964454 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 173/345] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:08 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:09.209804 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-115b9d8a-9883-499d-bbcb-9e782a20131b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:09.225162 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-115b9d8a-9883-499d-bbcb-9e782a20131b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:09.228367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-115b9d8a-9883-499d-bbcb-9e782a20131b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:09.229948 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-115b9d8a-9883-499d-bbcb-9e782a20131b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 0.334776 Oct 14 03:10:09.256690 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 173/346] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:08 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:09.989180 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-5b249e7f-0035-4f00-88ff-8f2706c6e113 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:09.990544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-5b249e7f-0035-4f00-88ff-8f2706c6e113 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:09.997456 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5b249e7f-0035-4f00-88ff-8f2706c6e113 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:09.998013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5b249e7f-0035-4f00-88ff-8f2706c6e113 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:09.998453 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5b249e7f-0035-4f00-88ff-8f2706c6e113 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:09.999152 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5b249e7f-0035-4f00-88ff-8f2706c6e113 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:09.999602 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5b249e7f-0035-4f00-88ff-8f2706c6e113 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:10.000021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5b249e7f-0035-4f00-88ff-8f2706c6e113 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:10.178924 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5b249e7f-0035-4f00-88ff-8f2706c6e113 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:10.187615 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-5b249e7f-0035-4f00-88ff-8f2706c6e113 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.202963 Oct 14 03:10:10.188340 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 174/347] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:09 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:10.262527 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a095155e-e439-4525-ab9f-fb105957cee1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:10.263048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a095155e-e439-4525-ab9f-fb105957cee1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:10.270301 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a095155e-e439-4525-ab9f-fb105957cee1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:10.271031 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a095155e-e439-4525-ab9f-fb105957cee1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:10.271643 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a095155e-e439-4525-ab9f-fb105957cee1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:10.272347 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a095155e-e439-4525-ab9f-fb105957cee1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:10.272821 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a095155e-e439-4525-ab9f-fb105957cee1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:10.273405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a095155e-e439-4525-ab9f-fb105957cee1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:10.449480 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a095155e-e439-4525-ab9f-fb105957cee1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:10.459179 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a095155e-e439-4525-ab9f-fb105957cee1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:10.461290 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a095155e-e439-4525-ab9f-fb105957cee1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:10.462894 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a095155e-e439-4525-ab9f-fb105957cee1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 0.204017 Oct 14 03:10:10.469073 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 174/348] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:10 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:11.211618 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d6e3c5e8-fb57-4602-90ef-8f1f7dbbb2f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:11.213578 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d6e3c5e8-fb57-4602-90ef-8f1f7dbbb2f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:11.221193 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d6e3c5e8-fb57-4602-90ef-8f1f7dbbb2f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.222604 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d6e3c5e8-fb57-4602-90ef-8f1f7dbbb2f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.223206 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d6e3c5e8-fb57-4602-90ef-8f1f7dbbb2f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.224373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d6e3c5e8-fb57-4602-90ef-8f1f7dbbb2f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.225002 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d6e3c5e8-fb57-4602-90ef-8f1f7dbbb2f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.225584 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d6e3c5e8-fb57-4602-90ef-8f1f7dbbb2f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.401932 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-d6e3c5e8-fb57-4602-90ef-8f1f7dbbb2f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:11.401932 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d6e3c5e8-fb57-4602-90ef-8f1f7dbbb2f0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.193387 Oct 14 03:10:11.403820 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 175/349] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:11 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:11.497687 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e644f35e-5044-4843-a323-ab8843d6d244 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:11.498286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e644f35e-5044-4843-a323-ab8843d6d244 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:11.506163 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e644f35e-5044-4843-a323-ab8843d6d244 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.506637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e644f35e-5044-4843-a323-ab8843d6d244 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.507068 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e644f35e-5044-4843-a323-ab8843d6d244 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.507748 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e644f35e-5044-4843-a323-ab8843d6d244 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.508193 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e644f35e-5044-4843-a323-ab8843d6d244 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.508644 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e644f35e-5044-4843-a323-ab8843d6d244 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.655922 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-e644f35e-5044-4843-a323-ab8843d6d244 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:11.664670 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-e644f35e-5044-4843-a323-ab8843d6d244 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:11.666139 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-e644f35e-5044-4843-a323-ab8843d6d244 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:11.667284 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e644f35e-5044-4843-a323-ab8843d6d244 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1738 microversion: 2.20 time: 0.176862 Oct 14 03:10:11.667840 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 175/350] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:11 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:12.423547 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-623f7989-a795-4bbb-9af0-e289ed10b618 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:12.424204 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-623f7989-a795-4bbb-9af0-e289ed10b618 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:12.431382 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-623f7989-a795-4bbb-9af0-e289ed10b618 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:12.431879 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-623f7989-a795-4bbb-9af0-e289ed10b618 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:12.432321 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-623f7989-a795-4bbb-9af0-e289ed10b618 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:12.433082 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-623f7989-a795-4bbb-9af0-e289ed10b618 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:12.433541 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-623f7989-a795-4bbb-9af0-e289ed10b618 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:12.433972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-623f7989-a795-4bbb-9af0-e289ed10b618 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:12.566661 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-623f7989-a795-4bbb-9af0-e289ed10b618 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:12.574777 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-623f7989-a795-4bbb-9af0-e289ed10b618 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.155128 Oct 14 03:10:12.579807 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 176/351] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:12 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:12.692084 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a8ebdf46-20de-49b7-90aa-5d0883170ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:12.692716 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a8ebdf46-20de-49b7-90aa-5d0883170ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:12.699179 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a8ebdf46-20de-49b7-90aa-5d0883170ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:12.699664 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a8ebdf46-20de-49b7-90aa-5d0883170ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:12.700186 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a8ebdf46-20de-49b7-90aa-5d0883170ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:12.700924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a8ebdf46-20de-49b7-90aa-5d0883170ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:12.701380 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a8ebdf46-20de-49b7-90aa-5d0883170ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:12.701807 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a8ebdf46-20de-49b7-90aa-5d0883170ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:12.707207 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=100 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:12.839750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a8ebdf46-20de-49b7-90aa-5d0883170ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:12.848401 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a8ebdf46-20de-49b7-90aa-5d0883170ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:12.849865 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a8ebdf46-20de-49b7-90aa-5d0883170ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:12.851031 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a8ebdf46-20de-49b7-90aa-5d0883170ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1720 microversion: 2.20 time: 0.162860 Oct 14 03:10:12.851597 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 176/352] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:12 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:12.926765 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-56b3e943-d0f4-45c1-a0df-d0ba4418550b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Action: 'create', calling method: .version_select at 0x7fdcc7863670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2002108838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIutwuq0Arn/gF4g6kCHbRbklhBQo8cmxQ3P/cZh6DFQeM4OWxtDhz4XnqeaAwTTH0xf2jj1naTbIS+W8+QwikSjHH6bE76i0Yy9eKLqq0v+HM2h5Rx7RM9773AYbqcGg=="}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:12.941736 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-56b3e943-d0f4-45c1-a0df-d0ba4418550b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Getting quotas for project 709ccf636093493093e88488ce49484f. Resources: {'key_pairs'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:10:12.945596 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-56b3e943-d0f4-45c1-a0df-d0ba4418550b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Getting quotas for user c79116777e354734b73a0b334fd013c9 and project 709ccf636093493093e88488ce49484f. Resources: {'key_pairs'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:10:13.082283 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-56b3e943-d0f4-45c1-a0df-d0ba4418550b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.159233 Oct 14 03:10:13.082892 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 177/353] 10.222.0.13 () {60 vars in 1159 bytes} [Fri Oct 14 03:10:12 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:13.219247 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-92909060", "imageRef": "917cea1e-a12f-45f3-8977-eacb3ba55783", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2002108838", "networks": [{"uuid": "0c4b7041-fa12-429e-b480-6ba452b8874b"}]}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:13.274750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.network.neutron [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] validate_networks() for [('0c4b7041-fa12-429e-b480-6ba452b8874b', None, None, None, None, None)] {{(pid=119301) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:10:13.597981 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3f3ab704-ca5d-48e6-8d0b-37b9bd3f5842 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:13.598595 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-3f3ab704-ca5d-48e6-8d0b-37b9bd3f5842 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:13.605453 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3f3ab704-ca5d-48e6-8d0b-37b9bd3f5842 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.606015 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3f3ab704-ca5d-48e6-8d0b-37b9bd3f5842 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.606697 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3f3ab704-ca5d-48e6-8d0b-37b9bd3f5842 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.607529 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3f3ab704-ca5d-48e6-8d0b-37b9bd3f5842 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.608223 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3f3ab704-ca5d-48e6-8d0b-37b9bd3f5842 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.608868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3f3ab704-ca5d-48e6-8d0b-37b9bd3f5842 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.824648 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Flavor limits 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:10:13.825388 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Image limits 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:10:13.826770 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Flavor pref 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:10:13.827460 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Image pref 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:10:13.827874 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:10:13.838905 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3f3ab704-ca5d-48e6-8d0b-37b9bd3f5842 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:13.839077 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.839448 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.839905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.840649 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.841525 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.841955 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.848024 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-3f3ab704-ca5d-48e6-8d0b-37b9bd3f5842 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.254584 Oct 14 03:10:13.848829 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 178/354] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:13 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:13.877239 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-7e87fb98-4540-4627-b34c-ca679ba3e268 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:13.877857 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-7e87fb98-4540-4627-b34c-ca679ba3e268 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:13.879820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Getting quotas for project 709ccf636093493093e88488ce49484f. Resources: {'instances', 'ram', 'cores'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:10:13.884231 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e87fb98-4540-4627-b34c-ca679ba3e268 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.884558 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Getting quotas for user c79116777e354734b73a0b334fd013c9 and project 709ccf636093493093e88488ce49484f. Resources: {'instances', 'ram', 'cores'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:10:13.885105 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e87fb98-4540-4627-b34c-ca679ba3e268 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.885705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e87fb98-4540-4627-b34c-ca679ba3e268 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.886557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e87fb98-4540-4627-b34c-ca679ba3e268 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.887199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e87fb98-4540-4627-b34c-ca679ba3e268 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.887616 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e87fb98-4540-4627-b34c-ca679ba3e268 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.897699 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Going to run 1 instances... {{(pid=119301) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:10:13.899945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='917cea1e-a12f-45f3-8977-eacb3ba55783',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119301) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:10:13.904074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=100 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:14.030079 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7e87fb98-4540-4627-b34c-ca679ba3e268 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:14.038640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7e87fb98-4540-4627-b34c-ca679ba3e268 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:14.040360 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7e87fb98-4540-4627-b34c-ca679ba3e268 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:14.041547 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-7e87fb98-4540-4627-b34c-ca679ba3e268 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1720 microversion: 2.20 time: 0.168510 Oct 14 03:10:14.042257 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 179/355] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:13 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:14.068505 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-053fc4de-3983-4509-b96a-1795601e1e3c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857399 Oct 14 03:10:14.069407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 177/356] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:10:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:10:14.081734 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-72097bc1-f702-4d4b-9b5d-b086f91d5a94 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:14.082520 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-72097bc1-f702-4d4b-9b5d-b086f91d5a94 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:14.138942 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-72097bc1-f702-4d4b-9b5d-b086f91d5a94 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:14.146062 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-72097bc1-f702-4d4b-9b5d-b086f91d5a94 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1257 microversion: 2.1 time: 0.069664 Oct 14 03:10:14.146646 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 180/357] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:14 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:14.871297 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-beb1466c-08ba-4b07-8c34-e3402aa33393 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:14.872479 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-beb1466c-08ba-4b07-8c34-e3402aa33393 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:14.882315 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb1466c-08ba-4b07-8c34-e3402aa33393 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:14.882874 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb1466c-08ba-4b07-8c34-e3402aa33393 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:14.883318 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb1466c-08ba-4b07-8c34-e3402aa33393 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:14.884016 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb1466c-08ba-4b07-8c34-e3402aa33393 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:14.884499 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb1466c-08ba-4b07-8c34-e3402aa33393 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:14.884928 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb1466c-08ba-4b07-8c34-e3402aa33393 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:15.017071 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-beb1466c-08ba-4b07-8c34-e3402aa33393 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:15.024765 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-beb1466c-08ba-4b07-8c34-e3402aa33393 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.157480 Oct 14 03:10:15.025332 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 178/358] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:14 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:15.071777 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-191fbcf9-4bee-45a7-b97e-47ddf852858c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:15.071777 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-191fbcf9-4bee-45a7-b97e-47ddf852858c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:15.075816 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-191fbcf9-4bee-45a7-b97e-47ddf852858c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:15.076316 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-191fbcf9-4bee-45a7-b97e-47ddf852858c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:15.077545 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-191fbcf9-4bee-45a7-b97e-47ddf852858c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:15.078266 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-191fbcf9-4bee-45a7-b97e-47ddf852858c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:15.078730 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-191fbcf9-4bee-45a7-b97e-47ddf852858c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:15.079168 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-191fbcf9-4bee-45a7-b97e-47ddf852858c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:15.169537 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9bb1ea9c-4096-4624-b584-4ecd4c5d70b4 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:15.170246 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-9bb1ea9c-4096-4624-b584-4ecd4c5d70b4 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:15.240887 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-9bb1ea9c-4096-4624-b584-4ecd4c5d70b4 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:15.244175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-191fbcf9-4bee-45a7-b97e-47ddf852858c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:15.248784 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9bb1ea9c-4096-4624-b584-4ecd4c5d70b4 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1257 microversion: 2.1 time: 0.083017 Oct 14 03:10:15.249561 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 179/359] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:15 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1257 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:15.254102 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-191fbcf9-4bee-45a7-b97e-47ddf852858c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:15.255732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-191fbcf9-4bee-45a7-b97e-47ddf852858c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:15.256768 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-4f9c5c8d-177f-4051-90b8-7ac4c6a33bf6 req-54d34299-45f4-48a3-a53c-e6e5e2fd212c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ae6b50-1d01-420e-ab83-6c856e0b35d4", "name": "network-vif-plugged", "status": "completed", "tag": "f66ba8f5-3869-4069-a4dc-7c7a64eb44d9"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:15.257285 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-191fbcf9-4bee-45a7-b97e-47ddf852858c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1723 microversion: 2.20 time: 0.193989 Oct 14 03:10:15.258659 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 181/360] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:15 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:15.282139 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-4f9c5c8d-177f-4051-90b8-7ac4c6a33bf6 req-54d34299-45f4-48a3-a53c-e6e5e2fd212c service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:15.282626 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-4f9c5c8d-177f-4051-90b8-7ac4c6a33bf6 req-54d34299-45f4-48a3-a53c-e6e5e2fd212c service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:15.283054 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-4f9c5c8d-177f-4051-90b8-7ac4c6a33bf6 req-54d34299-45f4-48a3-a53c-e6e5e2fd212c service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:15.291812 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d5f316c4-9dc0-42ef-aa9d-980871d10c81 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5760606-ff7c-4e5e-a45c-8c5ded8550c9"}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:15.294307 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d5f316c4-9dc0-42ef-aa9d-980871d10c81 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:15.295220 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-4f9c5c8d-177f-4051-90b8-7ac4c6a33bf6 req-54d34299-45f4-48a3-a53c-e6e5e2fd212c service nova] Creating event network-vif-plugged:f66ba8f5-3869-4069-a4dc-7c7a64eb44d9 for instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 on hv-cinder-80152 Oct 14 03:10:15.300282 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d5f316c4-9dc0-42ef-aa9d-980871d10c81 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:15.300904 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d5f316c4-9dc0-42ef-aa9d-980871d10c81 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:15.301019 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-4f9c5c8d-177f-4051-90b8-7ac4c6a33bf6 req-54d34299-45f4-48a3-a53c-e6e5e2fd212c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049842 Oct 14 03:10:15.301320 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d5f316c4-9dc0-42ef-aa9d-980871d10c81 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:15.301883 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 180/361] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:15.302636 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d5f316c4-9dc0-42ef-aa9d-980871d10c81 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:15.303145 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d5f316c4-9dc0-42ef-aa9d-980871d10c81 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:15.303577 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d5f316c4-9dc0-42ef-aa9d-980871d10c81 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:15.751500 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1662918130", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "networks": [{"uuid": "53fc415a-da17-4b6b-802b-8061304a5859"}]}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:15.808132 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.network.neutron [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] validate_networks() for [('53fc415a-da17-4b6b-802b-8061304a5859', None, None, None, None, None)] {{(pid=119301) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:10:16.161353 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Flavor limits 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:10:16.161916 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Image limits 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:10:16.162277 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Flavor pref 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:10:16.162665 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Image pref 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:10:16.163078 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:10:16.171953 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.172460 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.172896 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.173688 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.174135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.174561 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.192219 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Getting quotas for project faf6f8c0f3694f42a30232874a142685. Resources: {'instances', 'ram', 'cores'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:10:16.196168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Getting quotas for user 7175a36794194edba6b16366b0e12a0c and project faf6f8c0f3694f42a30232874a142685. Resources: {'instances', 'ram', 'cores'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:10:16.208363 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Going to run 1 instances... {{(pid=119301) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:10:16.210956 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119301) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:10:16.335144 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d5f316c4-9dc0-42ef-aa9d-980871d10c81 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "POST /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.047363 Oct 14 03:10:16.343630 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 182/362] 10.222.0.13 () {62 vars in 1364 bytes} [Fri Oct 14 03:10:15 2022] POST /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/os-volume_attachments => generated 188 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:10:16.343630 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-136184ed-7f20-4473-a4e0-a609a6973b6b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:16.343630 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-136184ed-7f20-4473-a4e0-a609a6973b6b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:16.348276 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-136184ed-7f20-4473-a4e0-a609a6973b6b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.350544 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5dd8b55c-d69c-4ad6-aeb9-dbacbec5f7b7 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603907 Oct 14 03:10:16.351427 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 181/363] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:10:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 14 03:10:16.355940 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fa8db932-f5e1-4d02-a7f9-d2a1be9af40f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:16.356579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fa8db932-f5e1-4d02-a7f9-d2a1be9af40f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:16.358844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-136184ed-7f20-4473-a4e0-a609a6973b6b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.359340 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-136184ed-7f20-4473-a4e0-a609a6973b6b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.360088 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-136184ed-7f20-4473-a4e0-a609a6973b6b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.360598 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-136184ed-7f20-4473-a4e0-a609a6973b6b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.364275 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fa8db932-f5e1-4d02-a7f9-d2a1be9af40f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.364788 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fa8db932-f5e1-4d02-a7f9-d2a1be9af40f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.365228 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fa8db932-f5e1-4d02-a7f9-d2a1be9af40f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.365936 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fa8db932-f5e1-4d02-a7f9-d2a1be9af40f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.366405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fa8db932-f5e1-4d02-a7f9-d2a1be9af40f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.366809 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fa8db932-f5e1-4d02-a7f9-d2a1be9af40f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.368591 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-136184ed-7f20-4473-a4e0-a609a6973b6b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.475924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fa8db932-f5e1-4d02-a7f9-d2a1be9af40f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:16.484829 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fa8db932-f5e1-4d02-a7f9-d2a1be9af40f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1253 microversion: 2.1 time: 0.132415 Oct 14 03:10:16.496089 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 182/364] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:16 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1253 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:16.506958 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3ac0bb77-cd82-4611-a202-684af843d83e tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:16.507592 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3ac0bb77-cd82-4611-a202-684af843d83e tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:16.574443 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3ac0bb77-cd82-4611-a202-684af843d83e tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:16.578638 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-136184ed-7f20-4473-a4e0-a609a6973b6b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:16.581582 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3ac0bb77-cd82-4611-a202-684af843d83e tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1219 microversion: 2.1 time: 0.078842 Oct 14 03:10:16.582158 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 183/365] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:16 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:16.587292 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-89cb6c9e-cfff-453a-af96-c338f9cb179d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:16.587504 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-89cb6c9e-cfff-453a-af96-c338f9cb179d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:16.590193 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-136184ed-7f20-4473-a4e0-a609a6973b6b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.252990 Oct 14 03:10:16.591235 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 183/366] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:16 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:16.596177 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-89cb6c9e-cfff-453a-af96-c338f9cb179d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.597277 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-89cb6c9e-cfff-453a-af96-c338f9cb179d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.600546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-89cb6c9e-cfff-453a-af96-c338f9cb179d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.600546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-89cb6c9e-cfff-453a-af96-c338f9cb179d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.600546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-89cb6c9e-cfff-453a-af96-c338f9cb179d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.600546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-89cb6c9e-cfff-453a-af96-c338f9cb179d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.642437 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-89cb6c9e-cfff-453a-af96-c338f9cb179d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119301) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 14 03:10:16.989880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-89cb6c9e-cfff-453a-af96-c338f9cb179d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "POST /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/action" status: 202 len: 0 microversion: 2.20 time: 0.406622 Oct 14 03:10:16.991292 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 184/367] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Oct 14 03:10:16 2022] POST /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:10:16.998954 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-185750a5-0bb6-410b-9b6f-e4aefb67e328 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:16.999657 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-185750a5-0bb6-410b-9b6f-e4aefb67e328 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:17.005793 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-185750a5-0bb6-410b-9b6f-e4aefb67e328 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.006286 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-185750a5-0bb6-410b-9b6f-e4aefb67e328 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.006746 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-185750a5-0bb6-410b-9b6f-e4aefb67e328 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.007438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-185750a5-0bb6-410b-9b6f-e4aefb67e328 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.007899 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-185750a5-0bb6-410b-9b6f-e4aefb67e328 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.008330 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-185750a5-0bb6-410b-9b6f-e4aefb67e328 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.140968 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-185750a5-0bb6-410b-9b6f-e4aefb67e328 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:17.151066 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-185750a5-0bb6-410b-9b6f-e4aefb67e328 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:17.152766 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-185750a5-0bb6-410b-9b6f-e4aefb67e328 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:17.154115 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-185750a5-0bb6-410b-9b6f-e4aefb67e328 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1749 microversion: 2.20 time: 0.159075 Oct 14 03:10:17.155058 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 184/368] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:16 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:17.318033 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-ebb55dcb-0566-4257-8fce-76c44b53c376 req-864fce0b-42b1-4f43-9b9b-07a94a68625b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866d9750-81fa-4eba-a3b7-b1c1182ed24d", "name": "network-vif-unplugged", "status": "completed", "tag": "846e0443-12a3-4f37-a28b-a559f43fd6b4"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:17.328008 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-ebb55dcb-0566-4257-8fce-76c44b53c376 req-864fce0b-42b1-4f43-9b9b-07a94a68625b service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.328511 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-ebb55dcb-0566-4257-8fce-76c44b53c376 req-864fce0b-42b1-4f43-9b9b-07a94a68625b service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.328947 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-ebb55dcb-0566-4257-8fce-76c44b53c376 req-864fce0b-42b1-4f43-9b9b-07a94a68625b service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.340986 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.compute.server_external_events [req-ebb55dcb-0566-4257-8fce-76c44b53c376 req-864fce0b-42b1-4f43-9b9b-07a94a68625b service nova] Unable to find a host for instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d. Dropping event network-vif-unplugged {{(pid=119301) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 14 03:10:17.341878 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-ebb55dcb-0566-4257-8fce-76c44b53c376 req-864fce0b-42b1-4f43-9b9b-07a94a68625b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028241 Oct 14 03:10:17.342629 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 185/369] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 14 03:10:17.509998 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d55a93cf-2628-468d-bdb4-1bffe13f270f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:17.510536 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d55a93cf-2628-468d-bdb4-1bffe13f270f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:17.516377 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d55a93cf-2628-468d-bdb4-1bffe13f270f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.516892 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d55a93cf-2628-468d-bdb4-1bffe13f270f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.517310 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d55a93cf-2628-468d-bdb4-1bffe13f270f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.517996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d55a93cf-2628-468d-bdb4-1bffe13f270f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.518444 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d55a93cf-2628-468d-bdb4-1bffe13f270f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.518881 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d55a93cf-2628-468d-bdb4-1bffe13f270f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.605307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f490069b-5267-41cb-a4f7-a1fe719dcd68 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:17.606173 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f490069b-5267-41cb-a4f7-a1fe719dcd68 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:17.608644 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-d55a93cf-2628-468d-bdb4-1bffe13f270f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:17.615800 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f490069b-5267-41cb-a4f7-a1fe719dcd68 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.616610 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f490069b-5267-41cb-a4f7-a1fe719dcd68 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.617533 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f490069b-5267-41cb-a4f7-a1fe719dcd68 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.618475 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d55a93cf-2628-468d-bdb4-1bffe13f270f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1309 microversion: 2.1 time: 0.112249 Oct 14 03:10:17.618661 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f490069b-5267-41cb-a4f7-a1fe719dcd68 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.619341 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 185/370] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:17 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:17.619753 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f490069b-5267-41cb-a4f7-a1fe719dcd68 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.620419 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f490069b-5267-41cb-a4f7-a1fe719dcd68 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.625346 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6c5a822b-d5a1-40ae-ae7f-0cb81a5ebf8b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:17.625908 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6c5a822b-d5a1-40ae-ae7f-0cb81a5ebf8b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:17.632795 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c5a822b-d5a1-40ae-ae7f-0cb81a5ebf8b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.633289 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c5a822b-d5a1-40ae-ae7f-0cb81a5ebf8b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.633737 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c5a822b-d5a1-40ae-ae7f-0cb81a5ebf8b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.634891 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c5a822b-d5a1-40ae-ae7f-0cb81a5ebf8b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.635491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c5a822b-d5a1-40ae-ae7f-0cb81a5ebf8b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.635836 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c5a822b-d5a1-40ae-ae7f-0cb81a5ebf8b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.730882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f490069b-5267-41cb-a4f7-a1fe719dcd68 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:17.741870 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f490069b-5267-41cb-a4f7-a1fe719dcd68 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1223 microversion: 2.1 time: 0.140674 Oct 14 03:10:17.742444 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 186/371] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:17 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1223 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:17.855406 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6c5a822b-d5a1-40ae-ae7f-0cb81a5ebf8b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:17.864076 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6c5a822b-d5a1-40ae-ae7f-0cb81a5ebf8b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1370 microversion: 2.1 time: 0.242995 Oct 14 03:10:17.864688 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 186/372] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:17 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:18.179756 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-4d3b8824-559e-4e9e-8364-b26e103abaa8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:18.180674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-4d3b8824-559e-4e9e-8364-b26e103abaa8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:18.186887 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4d3b8824-559e-4e9e-8364-b26e103abaa8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.187568 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4d3b8824-559e-4e9e-8364-b26e103abaa8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.188205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4d3b8824-559e-4e9e-8364-b26e103abaa8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.188720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4d3b8824-559e-4e9e-8364-b26e103abaa8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.189177 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4d3b8824-559e-4e9e-8364-b26e103abaa8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.189597 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4d3b8824-559e-4e9e-8364-b26e103abaa8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.540774 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4d3b8824-559e-4e9e-8364-b26e103abaa8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:18.550065 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4d3b8824-559e-4e9e-8364-b26e103abaa8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:18.551701 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4d3b8824-559e-4e9e-8364-b26e103abaa8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:18.552994 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-4d3b8824-559e-4e9e-8364-b26e103abaa8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1749 microversion: 2.20 time: 0.377597 Oct 14 03:10:18.553635 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 187/373] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:18 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1749 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:18.648744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-fc903824-d9b4-4c4d-9973-d2eef5ccb1ce tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:18.650780 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-fc903824-d9b4-4c4d-9973-d2eef5ccb1ce tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:18.664161 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc903824-d9b4-4c4d-9973-d2eef5ccb1ce tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.665859 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc903824-d9b4-4c4d-9973-d2eef5ccb1ce tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.665859 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc903824-d9b4-4c4d-9973-d2eef5ccb1ce tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.666095 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc903824-d9b4-4c4d-9973-d2eef5ccb1ce tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.666661 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc903824-d9b4-4c4d-9973-d2eef5ccb1ce tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.667210 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc903824-d9b4-4c4d-9973-d2eef5ccb1ce tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.747854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-fc903824-d9b4-4c4d-9973-d2eef5ccb1ce tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:18.757284 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-fc903824-d9b4-4c4d-9973-d2eef5ccb1ce tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1327 microversion: 2.1 time: 0.114532 Oct 14 03:10:18.757966 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 187/374] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:18 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1327 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:18.766832 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-231f3ef1-b47b-4057-96c1-24d0cd1f5845 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:18.767643 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-231f3ef1-b47b-4057-96c1-24d0cd1f5845 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:18.777055 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-231f3ef1-b47b-4057-96c1-24d0cd1f5845 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.777546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-231f3ef1-b47b-4057-96c1-24d0cd1f5845 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.777983 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-231f3ef1-b47b-4057-96c1-24d0cd1f5845 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.779034 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-231f3ef1-b47b-4057-96c1-24d0cd1f5845 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.779441 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-231f3ef1-b47b-4057-96c1-24d0cd1f5845 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.779858 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-231f3ef1-b47b-4057-96c1-24d0cd1f5845 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.852707 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-231f3ef1-b47b-4057-96c1-24d0cd1f5845 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:18.860282 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-231f3ef1-b47b-4057-96c1-24d0cd1f5845 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1271 microversion: 2.1 time: 0.098901 Oct 14 03:10:18.860884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 188/375] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:18 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:18.887136 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f89f3397-7dc1-491b-959d-a186c4f049dc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:18.887900 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f89f3397-7dc1-491b-959d-a186c4f049dc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:18.894019 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f89f3397-7dc1-491b-959d-a186c4f049dc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.895613 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f89f3397-7dc1-491b-959d-a186c4f049dc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.896191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f89f3397-7dc1-491b-959d-a186c4f049dc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.896985 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f89f3397-7dc1-491b-959d-a186c4f049dc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.897717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f89f3397-7dc1-491b-959d-a186c4f049dc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.898209 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f89f3397-7dc1-491b-959d-a186c4f049dc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.071049 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-f89f3397-7dc1-491b-959d-a186c4f049dc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:19.079266 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f89f3397-7dc1-491b-959d-a186c4f049dc tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1563 microversion: 2.1 time: 0.196006 Oct 14 03:10:19.079916 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 188/376] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:18 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1563 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:19.104962 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-69db5326-0b9e-4bde-a0b0-b868fbe0de55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:19.105384 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-69db5326-0b9e-4bde-a0b0-b868fbe0de55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:19.111668 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-69db5326-0b9e-4bde-a0b0-b868fbe0de55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:19.112382 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-69db5326-0b9e-4bde-a0b0-b868fbe0de55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:19.113557 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-69db5326-0b9e-4bde-a0b0-b868fbe0de55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.114429 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-69db5326-0b9e-4bde-a0b0-b868fbe0de55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:19.114887 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-69db5326-0b9e-4bde-a0b0-b868fbe0de55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:19.115314 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-69db5326-0b9e-4bde-a0b0-b868fbe0de55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.207978 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-69db5326-0b9e-4bde-a0b0-b868fbe0de55 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108670 Oct 14 03:10:19.208777 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 189/377] 10.222.0.13 () {58 vars in 1275 bytes} [Fri Oct 14 03:10:19 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:19.578909 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-843e179c-d87d-469c-b391-879739e60ab9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:19.579788 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-843e179c-d87d-469c-b391-879739e60ab9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:19.587779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-843e179c-d87d-469c-b391-879739e60ab9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:19.601185 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-843e179c-d87d-469c-b391-879739e60ab9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:19.601900 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-843e179c-d87d-469c-b391-879739e60ab9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.602930 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-843e179c-d87d-469c-b391-879739e60ab9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:19.603554 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-843e179c-d87d-469c-b391-879739e60ab9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:19.604143 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-843e179c-d87d-469c-b391-879739e60ab9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.795457 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0c4ae763-4cff-43fc-94a6-c264c23912b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:19.797754 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0c4ae763-4cff-43fc-94a6-c264c23912b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:19.801586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:19.811821 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0c4ae763-4cff-43fc-94a6-c264c23912b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:19.813056 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0c4ae763-4cff-43fc-94a6-c264c23912b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:19.814154 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0c4ae763-4cff-43fc-94a6-c264c23912b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.815267 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0c4ae763-4cff-43fc-94a6-c264c23912b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:19.816132 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0c4ae763-4cff-43fc-94a6-c264c23912b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:19.816842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0c4ae763-4cff-43fc-94a6-c264c23912b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:20.387366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-843e179c-d87d-469c-b391-879739e60ab9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:20.398205 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-843e179c-d87d-469c-b391-879739e60ab9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:20.399628 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-843e179c-d87d-469c-b391-879739e60ab9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:20.400934 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-843e179c-d87d-469c-b391-879739e60ab9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1751 microversion: 2.20 time: 0.826108 Oct 14 03:10:20.401944 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 189/378] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:19 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1751 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:20.407058 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-297cbedb-38d5-418a-909c-13ee08913f45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:20.407826 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-297cbedb-38d5-418a-909c-13ee08913f45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:20.414411 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-297cbedb-38d5-418a-909c-13ee08913f45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:20.415213 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-297cbedb-38d5-418a-909c-13ee08913f45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:20.415867 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-297cbedb-38d5-418a-909c-13ee08913f45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:20.416838 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-297cbedb-38d5-418a-909c-13ee08913f45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:20.417441 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-297cbedb-38d5-418a-909c-13ee08913f45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:20.418013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-297cbedb-38d5-418a-909c-13ee08913f45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:20.448791 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0c4ae763-4cff-43fc-94a6-c264c23912b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:20.472940 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0c4ae763-4cff-43fc-94a6-c264c23912b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.694425 Oct 14 03:10:20.473907 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 190/379] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:19 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:20.483205 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-cb0f2d82-b2cf-4e85-ac76-14e30900155e req-da8222d4-a3e0-406e-a5ab-00599d737175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c3606f-b3fb-4249-b5fd-a2de8f5debc2", "tag": "fcb4f2b3-a43c-4d79-98f7-46d493d8d296"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:20.495407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-cb0f2d82-b2cf-4e85-ac76-14e30900155e req-da8222d4-a3e0-406e-a5ab-00599d737175 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:20.495971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-cb0f2d82-b2cf-4e85-ac76-14e30900155e req-da8222d4-a3e0-406e-a5ab-00599d737175 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:20.496332 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-cb0f2d82-b2cf-4e85-ac76-14e30900155e req-da8222d4-a3e0-406e-a5ab-00599d737175 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:20.509542 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-cb0f2d82-b2cf-4e85-ac76-14e30900155e req-da8222d4-a3e0-406e-a5ab-00599d737175 service nova] Creating event network-changed:fcb4f2b3-a43c-4d79-98f7-46d493d8d296 for instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 on hv-cinder-80152 Oct 14 03:10:20.515219 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-cb0f2d82-b2cf-4e85-ac76-14e30900155e req-da8222d4-a3e0-406e-a5ab-00599d737175 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036984 Oct 14 03:10:20.516376 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 191/380] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:10:20.606427 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-297cbedb-38d5-418a-909c-13ee08913f45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:20.626711 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-297cbedb-38d5-418a-909c-13ee08913f45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1289 microversion: 2.1 time: 0.222944 Oct 14 03:10:20.631452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 190/381] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:20 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1289 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:21.181845 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-38797fdf-e224-4c41-b097-6a91fe20b8f5 req-dcdc2649-547a-4d28-a425-0128f561c794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ae6b50-1d01-420e-ab83-6c856e0b35d4", "tag": "f66ba8f5-3869-4069-a4dc-7c7a64eb44d9"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:21.193580 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-38797fdf-e224-4c41-b097-6a91fe20b8f5 req-dcdc2649-547a-4d28-a425-0128f561c794 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.194500 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-38797fdf-e224-4c41-b097-6a91fe20b8f5 req-dcdc2649-547a-4d28-a425-0128f561c794 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.195783 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-38797fdf-e224-4c41-b097-6a91fe20b8f5 req-dcdc2649-547a-4d28-a425-0128f561c794 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.209824 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-38797fdf-e224-4c41-b097-6a91fe20b8f5 req-dcdc2649-547a-4d28-a425-0128f561c794 service nova] Creating event network-changed:f66ba8f5-3869-4069-a4dc-7c7a64eb44d9 for instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 on hv-cinder-80152 Oct 14 03:10:21.215859 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-38797fdf-e224-4c41-b097-6a91fe20b8f5 req-dcdc2649-547a-4d28-a425-0128f561c794 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038522 Oct 14 03:10:21.216470 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 192/382] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:21.431053 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-bbb68095-4b90-4cbc-8c18-ec43783388d5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:21.433039 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-bbb68095-4b90-4cbc-8c18-ec43783388d5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:21.443295 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bbb68095-4b90-4cbc-8c18-ec43783388d5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.443881 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bbb68095-4b90-4cbc-8c18-ec43783388d5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.444375 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bbb68095-4b90-4cbc-8c18-ec43783388d5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.445185 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bbb68095-4b90-4cbc-8c18-ec43783388d5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.445720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bbb68095-4b90-4cbc-8c18-ec43783388d5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.446222 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bbb68095-4b90-4cbc-8c18-ec43783388d5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.504176 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e90c731a-114d-4cb9-865b-ff89a880ae77 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:21.505172 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e90c731a-114d-4cb9-865b-ff89a880ae77 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:21.515032 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e90c731a-114d-4cb9-865b-ff89a880ae77 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.515767 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e90c731a-114d-4cb9-865b-ff89a880ae77 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.516354 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e90c731a-114d-4cb9-865b-ff89a880ae77 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.517230 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e90c731a-114d-4cb9-865b-ff89a880ae77 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.517856 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e90c731a-114d-4cb9-865b-ff89a880ae77 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.518433 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e90c731a-114d-4cb9-865b-ff89a880ae77 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.700116 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-bbb68095-4b90-4cbc-8c18-ec43783388d5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:21.713864 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-bbb68095-4b90-4cbc-8c18-ec43783388d5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:21.715880 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-bbb68095-4b90-4cbc-8c18-ec43783388d5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:21.717517 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-bbb68095-4b90-4cbc-8c18-ec43783388d5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1751 microversion: 2.20 time: 0.292091 Oct 14 03:10:21.718872 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 191/383] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:21 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1751 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:21.723989 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-fa2ab8cd-1358-4e85-8518-351a80d9e4fb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:21.724885 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-fa2ab8cd-1358-4e85-8518-351a80d9e4fb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:21.735719 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fa2ab8cd-1358-4e85-8518-351a80d9e4fb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.736523 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fa2ab8cd-1358-4e85-8518-351a80d9e4fb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.737197 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fa2ab8cd-1358-4e85-8518-351a80d9e4fb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.738160 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fa2ab8cd-1358-4e85-8518-351a80d9e4fb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.738774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fa2ab8cd-1358-4e85-8518-351a80d9e4fb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.739118 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-e90c731a-114d-4cb9-865b-ff89a880ae77 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:21.739795 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fa2ab8cd-1358-4e85-8518-351a80d9e4fb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.748475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e90c731a-114d-4cb9-865b-ff89a880ae77 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.250198 Oct 14 03:10:21.756634 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 193/384] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:21 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:22.076419 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-fa2ab8cd-1358-4e85-8518-351a80d9e4fb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:22.088151 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-fa2ab8cd-1358-4e85-8518-351a80d9e4fb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1277 microversion: 2.1 time: 0.367992 Oct 14 03:10:22.088694 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 192/385] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:21 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1277 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:22.747817 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-333766c0-ae42-46ff-9225-37b83ad77e0f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:22.748508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-333766c0-ae42-46ff-9225-37b83ad77e0f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:22.755496 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-333766c0-ae42-46ff-9225-37b83ad77e0f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:22.756107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-333766c0-ae42-46ff-9225-37b83ad77e0f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:22.756691 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-333766c0-ae42-46ff-9225-37b83ad77e0f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:22.757516 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-333766c0-ae42-46ff-9225-37b83ad77e0f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:22.758176 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-333766c0-ae42-46ff-9225-37b83ad77e0f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:22.758883 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-333766c0-ae42-46ff-9225-37b83ad77e0f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:22.773880 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-35466a9f-9077-4b28-8499-96d4c8901205 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:22.774519 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-35466a9f-9077-4b28-8499-96d4c8901205 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:22.780753 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-35466a9f-9077-4b28-8499-96d4c8901205 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:22.781233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-35466a9f-9077-4b28-8499-96d4c8901205 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:22.781897 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-35466a9f-9077-4b28-8499-96d4c8901205 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:22.782602 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-35466a9f-9077-4b28-8499-96d4c8901205 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:22.783065 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-35466a9f-9077-4b28-8499-96d4c8901205 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:22.783494 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-35466a9f-9077-4b28-8499-96d4c8901205 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:22.986199 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-333766c0-ae42-46ff-9225-37b83ad77e0f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:22.997509 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-333766c0-ae42-46ff-9225-37b83ad77e0f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:22.999160 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-333766c0-ae42-46ff-9225-37b83ad77e0f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:23.000260 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-333766c0-ae42-46ff-9225-37b83ad77e0f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1751 microversion: 2.20 time: 0.256794 Oct 14 03:10:23.000857 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 194/386] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:22 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1751 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:23.011928 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-35466a9f-9077-4b28-8499-96d4c8901205 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:23.020437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-35466a9f-9077-4b28-8499-96d4c8901205 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.250356 Oct 14 03:10:23.021166 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 193/387] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:22 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:23.111602 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-88de0f9e-8cfe-4ddb-b9f7-cca240080ce3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:23.112219 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-88de0f9e-8cfe-4ddb-b9f7-cca240080ce3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:23.118318 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-88de0f9e-8cfe-4ddb-b9f7-cca240080ce3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:23.118795 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-88de0f9e-8cfe-4ddb-b9f7-cca240080ce3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:23.119230 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-88de0f9e-8cfe-4ddb-b9f7-cca240080ce3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:23.119919 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-88de0f9e-8cfe-4ddb-b9f7-cca240080ce3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:23.120371 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-88de0f9e-8cfe-4ddb-b9f7-cca240080ce3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:23.120831 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-88de0f9e-8cfe-4ddb-b9f7-cca240080ce3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:23.189928 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-88de0f9e-8cfe-4ddb-b9f7-cca240080ce3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:23.205529 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-88de0f9e-8cfe-4ddb-b9f7-cca240080ce3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1277 microversion: 2.1 time: 0.097741 Oct 14 03:10:23.207263 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 195/388] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:23 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:24.027075 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-83e95ab3-db90-40fb-a494-1fe5fd1f6d03 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:24.027836 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-83e95ab3-db90-40fb-a494-1fe5fd1f6d03 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:24.035191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-83e95ab3-db90-40fb-a494-1fe5fd1f6d03 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:24.035680 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-83e95ab3-db90-40fb-a494-1fe5fd1f6d03 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:24.036118 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-83e95ab3-db90-40fb-a494-1fe5fd1f6d03 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:24.036851 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-83e95ab3-db90-40fb-a494-1fe5fd1f6d03 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:24.037492 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-83e95ab3-db90-40fb-a494-1fe5fd1f6d03 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:24.037952 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-83e95ab3-db90-40fb-a494-1fe5fd1f6d03 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:24.045259 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-2538b7fd-0b87-46a7-9dd6-ed089d6945d2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:24.046666 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-2538b7fd-0b87-46a7-9dd6-ed089d6945d2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:24.054361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2538b7fd-0b87-46a7-9dd6-ed089d6945d2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:24.055162 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2538b7fd-0b87-46a7-9dd6-ed089d6945d2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:24.055821 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2538b7fd-0b87-46a7-9dd6-ed089d6945d2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:24.056945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2538b7fd-0b87-46a7-9dd6-ed089d6945d2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:24.057475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2538b7fd-0b87-46a7-9dd6-ed089d6945d2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:24.057986 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2538b7fd-0b87-46a7-9dd6-ed089d6945d2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:24.062449 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:24.143610 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=6 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:24.250270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-83e95ab3-db90-40fb-a494-1fe5fd1f6d03 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:24.252795 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-2538b7fd-0b87-46a7-9dd6-ed089d6945d2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:24.260522 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-83e95ab3-db90-40fb-a494-1fe5fd1f6d03 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:24.261306 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-2538b7fd-0b87-46a7-9dd6-ed089d6945d2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.219806 Oct 14 03:10:24.261887 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 196/389] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:24 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:24.262013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-83e95ab3-db90-40fb-a494-1fe5fd1f6d03 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:24.263161 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-83e95ab3-db90-40fb-a494-1fe5fd1f6d03 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1751 microversion: 2.20 time: 0.240122 Oct 14 03:10:24.263897 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 194/390] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:24 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1751 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:24.266310 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0795285d-3c50-4cec-ab3b-4115e2263b62 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:24.266920 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0795285d-3c50-4cec-ab3b-4115e2263b62 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:24.273403 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0795285d-3c50-4cec-ab3b-4115e2263b62 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:24.273892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0795285d-3c50-4cec-ab3b-4115e2263b62 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:24.274331 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0795285d-3c50-4cec-ab3b-4115e2263b62 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:24.275025 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0795285d-3c50-4cec-ab3b-4115e2263b62 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:24.278012 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0795285d-3c50-4cec-ab3b-4115e2263b62 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:24.278562 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0795285d-3c50-4cec-ab3b-4115e2263b62 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:24.346570 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0795285d-3c50-4cec-ab3b-4115e2263b62 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:24.355224 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0795285d-3c50-4cec-ab3b-4115e2263b62 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1277 microversion: 2.1 time: 0.092174 Oct 14 03:10:24.355832 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 197/391] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:24 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:25.284572 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8aca9828-ab32-4e4c-97d8-987824ac7d76 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:25.285365 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8aca9828-ab32-4e4c-97d8-987824ac7d76 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:25.288974 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0a56ef66-8947-4b26-8ca2-426ebbd9506a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:25.289739 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0a56ef66-8947-4b26-8ca2-426ebbd9506a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:25.292091 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8aca9828-ab32-4e4c-97d8-987824ac7d76 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:25.292615 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8aca9828-ab32-4e4c-97d8-987824ac7d76 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:25.293058 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8aca9828-ab32-4e4c-97d8-987824ac7d76 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:25.293774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8aca9828-ab32-4e4c-97d8-987824ac7d76 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:25.294312 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8aca9828-ab32-4e4c-97d8-987824ac7d76 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:25.294660 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8aca9828-ab32-4e4c-97d8-987824ac7d76 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:25.296582 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0a56ef66-8947-4b26-8ca2-426ebbd9506a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:25.297067 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0a56ef66-8947-4b26-8ca2-426ebbd9506a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:25.297661 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0a56ef66-8947-4b26-8ca2-426ebbd9506a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:25.298538 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0a56ef66-8947-4b26-8ca2-426ebbd9506a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:25.298992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0a56ef66-8947-4b26-8ca2-426ebbd9506a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:25.299417 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0a56ef66-8947-4b26-8ca2-426ebbd9506a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:25.304110 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:25.502915 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8aca9828-ab32-4e4c-97d8-987824ac7d76 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:25.513020 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8aca9828-ab32-4e4c-97d8-987824ac7d76 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.232664 Oct 14 03:10:25.513221 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0a56ef66-8947-4b26-8ca2-426ebbd9506a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:25.514069 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 195/392] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:25 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:25.519280 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9d993264-a701-4294-a482-48483aa355b3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:25.520167 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9d993264-a701-4294-a482-48483aa355b3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:25.528720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9d993264-a701-4294-a482-48483aa355b3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:25.529685 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9d993264-a701-4294-a482-48483aa355b3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:25.530428 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9d993264-a701-4294-a482-48483aa355b3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:25.531671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9d993264-a701-4294-a482-48483aa355b3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:25.532559 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9d993264-a701-4294-a482-48483aa355b3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:25.533294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9d993264-a701-4294-a482-48483aa355b3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:25.538413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0a56ef66-8947-4b26-8ca2-426ebbd9506a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:25.540125 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0a56ef66-8947-4b26-8ca2-426ebbd9506a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:25.541368 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0a56ef66-8947-4b26-8ca2-426ebbd9506a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1751 microversion: 2.20 time: 0.256617 Oct 14 03:10:25.541930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 198/393] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:25 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1751 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:25.603919 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9d993264-a701-4294-a482-48483aa355b3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:25.611868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9d993264-a701-4294-a482-48483aa355b3 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1277 microversion: 2.1 time: 0.096594 Oct 14 03:10:25.618340 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 196/394] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:25 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:26.538145 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f8306d3d-6c69-47f0-b9b6-c96e04d08a78 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:26.538818 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f8306d3d-6c69-47f0-b9b6-c96e04d08a78 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:26.540612 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=4 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:26.546304 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f8306d3d-6c69-47f0-b9b6-c96e04d08a78 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:26.546880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f8306d3d-6c69-47f0-b9b6-c96e04d08a78 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:26.547313 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f8306d3d-6c69-47f0-b9b6-c96e04d08a78 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:26.548018 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f8306d3d-6c69-47f0-b9b6-c96e04d08a78 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:26.548494 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f8306d3d-6c69-47f0-b9b6-c96e04d08a78 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:26.550596 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f8306d3d-6c69-47f0-b9b6-c96e04d08a78 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:26.567900 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8f79480d-a711-4ff0-97b7-ca1778561640 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:26.569232 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8f79480d-a711-4ff0-97b7-ca1778561640 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:26.578818 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8f79480d-a711-4ff0-97b7-ca1778561640 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:26.579391 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8f79480d-a711-4ff0-97b7-ca1778561640 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:26.579903 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8f79480d-a711-4ff0-97b7-ca1778561640 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:26.580695 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8f79480d-a711-4ff0-97b7-ca1778561640 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:26.580959 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=16 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:26.581320 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8f79480d-a711-4ff0-97b7-ca1778561640 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:26.581989 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8f79480d-a711-4ff0-97b7-ca1778561640 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:26.783341 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f8306d3d-6c69-47f0-b9b6-c96e04d08a78 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:26.787004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8f79480d-a711-4ff0-97b7-ca1778561640 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:26.793044 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f8306d3d-6c69-47f0-b9b6-c96e04d08a78 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.258747 Oct 14 03:10:26.793631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 199/395] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:26 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:26.797298 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8f79480d-a711-4ff0-97b7-ca1778561640 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:26.798394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-49401dc9-fbd9-461d-a246-6cc614ec4952 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:26.799028 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8f79480d-a711-4ff0-97b7-ca1778561640 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:26.799165 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-49401dc9-fbd9-461d-a246-6cc614ec4952 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:26.800759 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8f79480d-a711-4ff0-97b7-ca1778561640 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1751 microversion: 2.20 time: 0.237475 Oct 14 03:10:26.801704 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 197/396] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:26 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1751 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:26.805927 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49401dc9-fbd9-461d-a246-6cc614ec4952 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:26.806412 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49401dc9-fbd9-461d-a246-6cc614ec4952 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:26.806846 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49401dc9-fbd9-461d-a246-6cc614ec4952 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:26.807544 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49401dc9-fbd9-461d-a246-6cc614ec4952 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:26.808000 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49401dc9-fbd9-461d-a246-6cc614ec4952 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:26.808438 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49401dc9-fbd9-461d-a246-6cc614ec4952 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:26.876954 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-49401dc9-fbd9-461d-a246-6cc614ec4952 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:26.885861 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-49401dc9-fbd9-461d-a246-6cc614ec4952 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1277 microversion: 2.1 time: 0.091026 Oct 14 03:10:26.886788 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 200/397] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:26 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:27.815950 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-dd7d2d4d-8245-43b5-aa5a-639a06272ca0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:27.816594 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-dd7d2d4d-8245-43b5-aa5a-639a06272ca0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:27.823700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd7d2d4d-8245-43b5-aa5a-639a06272ca0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:27.824200 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd7d2d4d-8245-43b5-aa5a-639a06272ca0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:27.824661 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd7d2d4d-8245-43b5-aa5a-639a06272ca0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:27.825373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd7d2d4d-8245-43b5-aa5a-639a06272ca0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:27.825829 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd7d2d4d-8245-43b5-aa5a-639a06272ca0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:27.826518 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd7d2d4d-8245-43b5-aa5a-639a06272ca0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:27.828818 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1237e9b3-e742-4787-add4-3338c72d57ea tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:27.829715 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1237e9b3-e742-4787-add4-3338c72d57ea tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:27.835305 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1237e9b3-e742-4787-add4-3338c72d57ea tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:27.835805 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1237e9b3-e742-4787-add4-3338c72d57ea tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:27.836245 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1237e9b3-e742-4787-add4-3338c72d57ea tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:27.836993 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1237e9b3-e742-4787-add4-3338c72d57ea tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:27.837451 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1237e9b3-e742-4787-add4-3338c72d57ea tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:27.837881 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1237e9b3-e742-4787-add4-3338c72d57ea tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:28.039308 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-dd7d2d4d-8245-43b5-aa5a-639a06272ca0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:28.039618 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1237e9b3-e742-4787-add4-3338c72d57ea tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:28.042200 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-dd7d2d4d-8245-43b5-aa5a-639a06272ca0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.230059 Oct 14 03:10:28.042782 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 198/398] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:27 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:28.047208 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-bb94bfc9-e6a2-446c-a60a-bdd3b85ee4c6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:28.047811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-bb94bfc9-e6a2-446c-a60a-bdd3b85ee4c6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:28.048414 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1237e9b3-e742-4787-add4-3338c72d57ea tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:28.050034 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1237e9b3-e742-4787-add4-3338c72d57ea tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:28.051504 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1237e9b3-e742-4787-add4-3338c72d57ea tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1751 microversion: 2.20 time: 0.227662 Oct 14 03:10:28.053059 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 201/399] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:27 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1751 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:28.053729 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bb94bfc9-e6a2-446c-a60a-bdd3b85ee4c6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:28.054211 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bb94bfc9-e6a2-446c-a60a-bdd3b85ee4c6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:28.054648 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bb94bfc9-e6a2-446c-a60a-bdd3b85ee4c6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:28.055344 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bb94bfc9-e6a2-446c-a60a-bdd3b85ee4c6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:28.055796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bb94bfc9-e6a2-446c-a60a-bdd3b85ee4c6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:28.056220 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bb94bfc9-e6a2-446c-a60a-bdd3b85ee4c6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:28.121139 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-bb94bfc9-e6a2-446c-a60a-bdd3b85ee4c6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:28.128675 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-bb94bfc9-e6a2-446c-a60a-bdd3b85ee4c6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1277 microversion: 2.1 time: 0.084914 Oct 14 03:10:28.129446 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 199/400] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:28 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:29.065345 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-2260046d-de94-4af8-aa5e-00c29c0d1980 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:29.067131 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-2260046d-de94-4af8-aa5e-00c29c0d1980 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:29.074141 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2260046d-de94-4af8-aa5e-00c29c0d1980 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:29.074634 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2260046d-de94-4af8-aa5e-00c29c0d1980 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:29.075066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2260046d-de94-4af8-aa5e-00c29c0d1980 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:29.075963 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2260046d-de94-4af8-aa5e-00c29c0d1980 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:29.076703 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2260046d-de94-4af8-aa5e-00c29c0d1980 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:29.077124 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2260046d-de94-4af8-aa5e-00c29c0d1980 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:29.079827 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-63cee21d-d871-49b4-810d-da3264b7daa3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:29.080730 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-63cee21d-d871-49b4-810d-da3264b7daa3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:29.089472 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-63cee21d-d871-49b4-810d-da3264b7daa3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:29.090446 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-63cee21d-d871-49b4-810d-da3264b7daa3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:29.090908 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-63cee21d-d871-49b4-810d-da3264b7daa3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:29.098105 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-63cee21d-d871-49b4-810d-da3264b7daa3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:29.098712 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-63cee21d-d871-49b4-810d-da3264b7daa3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:29.099170 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-63cee21d-d871-49b4-810d-da3264b7daa3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:29.275356 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-2260046d-de94-4af8-aa5e-00c29c0d1980 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:29.285805 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-2260046d-de94-4af8-aa5e-00c29c0d1980 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.224691 Oct 14 03:10:29.286546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 202/401] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:29 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:29.292210 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-86a96783-d6dd-4f5b-853d-6e557b304220 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:29.293056 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-86a96783-d6dd-4f5b-853d-6e557b304220 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:29.305580 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-86a96783-d6dd-4f5b-853d-6e557b304220 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:29.306306 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-86a96783-d6dd-4f5b-853d-6e557b304220 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:29.307741 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-86a96783-d6dd-4f5b-853d-6e557b304220 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:29.311961 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-86a96783-d6dd-4f5b-853d-6e557b304220 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:29.311961 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-86a96783-d6dd-4f5b-853d-6e557b304220 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:29.311961 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-86a96783-d6dd-4f5b-853d-6e557b304220 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:29.322326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-63cee21d-d871-49b4-810d-da3264b7daa3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:29.334482 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-63cee21d-d871-49b4-810d-da3264b7daa3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:29.336195 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-63cee21d-d871-49b4-810d-da3264b7daa3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:29.337674 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-63cee21d-d871-49b4-810d-da3264b7daa3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.262837 Oct 14 03:10:29.338740 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 200/402] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:29 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:29.398180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-86a96783-d6dd-4f5b-853d-6e557b304220 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:29.401122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-86a96783-d6dd-4f5b-853d-6e557b304220 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1277 microversion: 2.1 time: 0.113042 Oct 14 03:10:29.402171 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 203/403] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:29 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:30.309298 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-93ee01ad-21a6-41f5-8e1e-9e01977fffab tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:30.309947 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-93ee01ad-21a6-41f5-8e1e-9e01977fffab tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:30.316977 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-93ee01ad-21a6-41f5-8e1e-9e01977fffab tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:30.317471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-93ee01ad-21a6-41f5-8e1e-9e01977fffab tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:30.317915 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-93ee01ad-21a6-41f5-8e1e-9e01977fffab tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:30.318618 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-93ee01ad-21a6-41f5-8e1e-9e01977fffab tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:30.319077 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-93ee01ad-21a6-41f5-8e1e-9e01977fffab tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:30.319508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-93ee01ad-21a6-41f5-8e1e-9e01977fffab tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:30.364144 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-02876f21-8903-481b-8578-53987d5842bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:30.365414 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-02876f21-8903-481b-8578-53987d5842bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:30.371583 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-02876f21-8903-481b-8578-53987d5842bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:30.372109 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-02876f21-8903-481b-8578-53987d5842bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:30.372605 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-02876f21-8903-481b-8578-53987d5842bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:30.373539 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-02876f21-8903-481b-8578-53987d5842bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:30.374004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-02876f21-8903-481b-8578-53987d5842bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:30.374440 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-02876f21-8903-481b-8578-53987d5842bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:30.497779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-93ee01ad-21a6-41f5-8e1e-9e01977fffab tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:30.506838 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-93ee01ad-21a6-41f5-8e1e-9e01977fffab tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.201388 Oct 14 03:10:30.507557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 201/404] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:30 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:30.514451 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-4cdb1b74-b35a-4c42-b10c-0ee84415a047 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:30.515350 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-4cdb1b74-b35a-4c42-b10c-0ee84415a047 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:30.522127 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4cdb1b74-b35a-4c42-b10c-0ee84415a047 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:30.522963 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4cdb1b74-b35a-4c42-b10c-0ee84415a047 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:30.523653 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4cdb1b74-b35a-4c42-b10c-0ee84415a047 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:30.524493 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4cdb1b74-b35a-4c42-b10c-0ee84415a047 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:30.525177 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4cdb1b74-b35a-4c42-b10c-0ee84415a047 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:30.525704 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4cdb1b74-b35a-4c42-b10c-0ee84415a047 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:30.533942 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-02876f21-8903-481b-8578-53987d5842bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:30.543922 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-02876f21-8903-481b-8578-53987d5842bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:30.545541 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-02876f21-8903-481b-8578-53987d5842bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:30.546797 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-02876f21-8903-481b-8578-53987d5842bd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.187587 Oct 14 03:10:30.547435 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 204/405] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:30 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:30.667203 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4cdb1b74-b35a-4c42-b10c-0ee84415a047 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:30.675915 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-4cdb1b74-b35a-4c42-b10c-0ee84415a047 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.167004 Oct 14 03:10:30.681936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 202/406] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:30 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:31.531069 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-50fa9350-2483-4e11-b0ad-b266cf6b42f4 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:31.531680 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-50fa9350-2483-4e11-b0ad-b266cf6b42f4 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:31.538180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-50fa9350-2483-4e11-b0ad-b266cf6b42f4 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:31.548764 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-50fa9350-2483-4e11-b0ad-b266cf6b42f4 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:31.548764 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-50fa9350-2483-4e11-b0ad-b266cf6b42f4 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:31.548764 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-50fa9350-2483-4e11-b0ad-b266cf6b42f4 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:31.548764 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-50fa9350-2483-4e11-b0ad-b266cf6b42f4 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:31.549175 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-50fa9350-2483-4e11-b0ad-b266cf6b42f4 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:31.572494 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-58696478-351a-458f-832b-ae1bcfe3ac15 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:31.573070 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-58696478-351a-458f-832b-ae1bcfe3ac15 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:31.580432 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-58696478-351a-458f-832b-ae1bcfe3ac15 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:31.581510 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-58696478-351a-458f-832b-ae1bcfe3ac15 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:31.581956 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-58696478-351a-458f-832b-ae1bcfe3ac15 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:31.582676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-58696478-351a-458f-832b-ae1bcfe3ac15 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:31.583340 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-58696478-351a-458f-832b-ae1bcfe3ac15 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:31.583780 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-58696478-351a-458f-832b-ae1bcfe3ac15 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:31.724762 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-50fa9350-2483-4e11-b0ad-b266cf6b42f4 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:31.732642 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-50fa9350-2483-4e11-b0ad-b266cf6b42f4 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.205292 Oct 14 03:10:31.733244 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 205/407] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:31 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:31.742092 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-bdffedf6-8880-45d5-9bbb-e49326cdcaff req-ff52fe70-9c40-433c-a373-3c4928926e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dba68e3-51ca-4ce2-9165-0d04c196138a", "tag": "5e3c73a5-6040-4749-994f-19fa7172d3e2"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:31.753778 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-bdffedf6-8880-45d5-9bbb-e49326cdcaff req-ff52fe70-9c40-433c-a373-3c4928926e12 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:31.754032 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-bdffedf6-8880-45d5-9bbb-e49326cdcaff req-ff52fe70-9c40-433c-a373-3c4928926e12 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:31.754456 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-bdffedf6-8880-45d5-9bbb-e49326cdcaff req-ff52fe70-9c40-433c-a373-3c4928926e12 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:31.756378 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-58696478-351a-458f-832b-ae1bcfe3ac15 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:31.765090 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-58696478-351a-458f-832b-ae1bcfe3ac15 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:31.765744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-bdffedf6-8880-45d5-9bbb-e49326cdcaff req-ff52fe70-9c40-433c-a373-3c4928926e12 service nova] Creating event network-changed:5e3c73a5-6040-4749-994f-19fa7172d3e2 for instance 0dba68e3-51ca-4ce2-9165-0d04c196138a on hv-cinder-80152 Oct 14 03:10:31.766544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-58696478-351a-458f-832b-ae1bcfe3ac15 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:31.767701 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-58696478-351a-458f-832b-ae1bcfe3ac15 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.199435 Oct 14 03:10:31.768324 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 203/408] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:31 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:31.770661 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-bdffedf6-8880-45d5-9bbb-e49326cdcaff req-ff52fe70-9c40-433c-a373-3c4928926e12 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035459 Oct 14 03:10:31.771382 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 206/409] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:31.774684 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3b1cec48-7e8b-4fc3-9303-606e43d7cf88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:31.775291 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-3b1cec48-7e8b-4fc3-9303-606e43d7cf88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:31.781100 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3b1cec48-7e8b-4fc3-9303-606e43d7cf88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:31.781584 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3b1cec48-7e8b-4fc3-9303-606e43d7cf88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:31.782021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3b1cec48-7e8b-4fc3-9303-606e43d7cf88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:31.782707 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3b1cec48-7e8b-4fc3-9303-606e43d7cf88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:31.783162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3b1cec48-7e8b-4fc3-9303-606e43d7cf88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:31.783590 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3b1cec48-7e8b-4fc3-9303-606e43d7cf88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:31.909530 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3b1cec48-7e8b-4fc3-9303-606e43d7cf88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:31.917193 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-3b1cec48-7e8b-4fc3-9303-606e43d7cf88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.146833 Oct 14 03:10:31.917744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 204/410] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:31 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:32.756346 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-938895d5-9468-42dc-af44-50830cb4c5b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:32.757123 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-938895d5-9468-42dc-af44-50830cb4c5b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:32.763312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-938895d5-9468-42dc-af44-50830cb4c5b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:32.764181 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-938895d5-9468-42dc-af44-50830cb4c5b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:32.764452 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-938895d5-9468-42dc-af44-50830cb4c5b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:32.765186 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-938895d5-9468-42dc-af44-50830cb4c5b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:32.765770 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-938895d5-9468-42dc-af44-50830cb4c5b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:32.766082 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-938895d5-9468-42dc-af44-50830cb4c5b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:32.793299 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8ac4e907-6dbb-4b33-af2f-88aee2abb842 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:32.793991 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8ac4e907-6dbb-4b33-af2f-88aee2abb842 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:32.800550 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8ac4e907-6dbb-4b33-af2f-88aee2abb842 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:32.802205 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8ac4e907-6dbb-4b33-af2f-88aee2abb842 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:32.802522 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8ac4e907-6dbb-4b33-af2f-88aee2abb842 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:32.803231 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8ac4e907-6dbb-4b33-af2f-88aee2abb842 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:32.803775 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8ac4e907-6dbb-4b33-af2f-88aee2abb842 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:32.804202 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8ac4e907-6dbb-4b33-af2f-88aee2abb842 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:32.972532 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-938895d5-9468-42dc-af44-50830cb4c5b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:32.984519 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-938895d5-9468-42dc-af44-50830cb4c5b0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.232692 Oct 14 03:10:32.986246 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 207/411] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:32 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:32.991333 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-64f9850c-a063-4bef-afa1-24efde7b61c1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:32.992231 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-64f9850c-a063-4bef-afa1-24efde7b61c1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:32.999690 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-64f9850c-a063-4bef-afa1-24efde7b61c1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:33.000478 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-64f9850c-a063-4bef-afa1-24efde7b61c1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:33.001290 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-64f9850c-a063-4bef-afa1-24efde7b61c1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:33.003206 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-64f9850c-a063-4bef-afa1-24efde7b61c1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:33.005097 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-64f9850c-a063-4bef-afa1-24efde7b61c1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:33.005763 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-64f9850c-a063-4bef-afa1-24efde7b61c1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:33.010912 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8ac4e907-6dbb-4b33-af2f-88aee2abb842 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:33.022549 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8ac4e907-6dbb-4b33-af2f-88aee2abb842 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:33.024320 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8ac4e907-6dbb-4b33-af2f-88aee2abb842 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:33.025767 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8ac4e907-6dbb-4b33-af2f-88aee2abb842 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.236403 Oct 14 03:10:33.026899 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 205/412] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:32 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:33.202796 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-64f9850c-a063-4bef-afa1-24efde7b61c1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:33.213268 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-64f9850c-a063-4bef-afa1-24efde7b61c1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.225500 Oct 14 03:10:33.228570 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 208/413] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:32 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:34.012571 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2bda9260-e203-469d-8685-ffd18ffdf233 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:34.013193 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2bda9260-e203-469d-8685-ffd18ffdf233 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:34.019932 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2bda9260-e203-469d-8685-ffd18ffdf233 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:34.020437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2bda9260-e203-469d-8685-ffd18ffdf233 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:34.020879 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2bda9260-e203-469d-8685-ffd18ffdf233 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:34.021586 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2bda9260-e203-469d-8685-ffd18ffdf233 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:34.022045 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2bda9260-e203-469d-8685-ffd18ffdf233 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:34.022473 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2bda9260-e203-469d-8685-ffd18ffdf233 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:34.051141 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3c85360e-9e1a-45ab-bed3-b066ea27a54c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:34.051745 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3c85360e-9e1a-45ab-bed3-b066ea27a54c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:34.058363 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3c85360e-9e1a-45ab-bed3-b066ea27a54c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:34.058845 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3c85360e-9e1a-45ab-bed3-b066ea27a54c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:34.059506 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3c85360e-9e1a-45ab-bed3-b066ea27a54c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:34.060555 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3c85360e-9e1a-45ab-bed3-b066ea27a54c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:34.061212 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3c85360e-9e1a-45ab-bed3-b066ea27a54c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:34.061925 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3c85360e-9e1a-45ab-bed3-b066ea27a54c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:34.244340 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2bda9260-e203-469d-8685-ffd18ffdf233 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:34.249217 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3c85360e-9e1a-45ab-bed3-b066ea27a54c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:34.261868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2bda9260-e203-469d-8685-ffd18ffdf233 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.244982 Oct 14 03:10:34.261868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 206/414] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:34 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:34.262135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3c85360e-9e1a-45ab-bed3-b066ea27a54c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:34.262252 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-36739f3f-3623-4645-80d9-1ea267a72c82 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:34.262252 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-36739f3f-3623-4645-80d9-1ea267a72c82 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:34.262404 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3c85360e-9e1a-45ab-bed3-b066ea27a54c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:34.262404 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3c85360e-9e1a-45ab-bed3-b066ea27a54c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.213815 Oct 14 03:10:34.266367 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-36739f3f-3623-4645-80d9-1ea267a72c82 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:34.266878 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-36739f3f-3623-4645-80d9-1ea267a72c82 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:34.267697 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-36739f3f-3623-4645-80d9-1ea267a72c82 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:34.269390 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-36739f3f-3623-4645-80d9-1ea267a72c82 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:34.270155 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-36739f3f-3623-4645-80d9-1ea267a72c82 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:34.271146 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-36739f3f-3623-4645-80d9-1ea267a72c82 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:34.279193 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 209/415] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:34 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:34.411613 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-36739f3f-3623-4645-80d9-1ea267a72c82 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:34.419679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-36739f3f-3623-4645-80d9-1ea267a72c82 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.164265 Oct 14 03:10:34.420145 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 207/416] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:34 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:35.278199 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d88929a6-7976-4b25-8798-a6d75d6b4ca7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:35.278950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d88929a6-7976-4b25-8798-a6d75d6b4ca7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:35.287226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e59ce66d-d32b-4952-9dc3-eb14c39a54d1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:35.287802 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d88929a6-7976-4b25-8798-a6d75d6b4ca7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:35.287802 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d88929a6-7976-4b25-8798-a6d75d6b4ca7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:35.288004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e59ce66d-d32b-4952-9dc3-eb14c39a54d1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:35.289452 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d88929a6-7976-4b25-8798-a6d75d6b4ca7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:35.289452 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d88929a6-7976-4b25-8798-a6d75d6b4ca7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:35.289822 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d88929a6-7976-4b25-8798-a6d75d6b4ca7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:35.290304 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d88929a6-7976-4b25-8798-a6d75d6b4ca7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:35.295596 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e59ce66d-d32b-4952-9dc3-eb14c39a54d1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:35.296097 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e59ce66d-d32b-4952-9dc3-eb14c39a54d1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:35.296573 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e59ce66d-d32b-4952-9dc3-eb14c39a54d1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:35.297273 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e59ce66d-d32b-4952-9dc3-eb14c39a54d1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:35.297726 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e59ce66d-d32b-4952-9dc3-eb14c39a54d1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:35.298151 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e59ce66d-d32b-4952-9dc3-eb14c39a54d1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:35.479834 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d88929a6-7976-4b25-8798-a6d75d6b4ca7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:35.489369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d88929a6-7976-4b25-8798-a6d75d6b4ca7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.214927 Oct 14 03:10:35.490293 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 210/417] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:35 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:35.506927 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d9e71e0c-7060-4c3e-9745-88a10043d9e5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:35.507541 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d9e71e0c-7060-4c3e-9745-88a10043d9e5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:35.513669 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e59ce66d-d32b-4952-9dc3-eb14c39a54d1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:35.514999 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9e71e0c-7060-4c3e-9745-88a10043d9e5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:35.515495 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9e71e0c-7060-4c3e-9745-88a10043d9e5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:35.516080 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9e71e0c-7060-4c3e-9745-88a10043d9e5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:35.517268 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9e71e0c-7060-4c3e-9745-88a10043d9e5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:35.517731 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9e71e0c-7060-4c3e-9745-88a10043d9e5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:35.518159 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9e71e0c-7060-4c3e-9745-88a10043d9e5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:35.526778 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e59ce66d-d32b-4952-9dc3-eb14c39a54d1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:35.528844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e59ce66d-d32b-4952-9dc3-eb14c39a54d1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:35.530194 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e59ce66d-d32b-4952-9dc3-eb14c39a54d1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.247426 Oct 14 03:10:35.531319 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 208/418] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:35 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:35.666799 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d9e71e0c-7060-4c3e-9745-88a10043d9e5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:35.674831 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d9e71e0c-7060-4c3e-9745-88a10043d9e5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.183312 Oct 14 03:10:35.675415 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 211/419] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:35 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:36.441922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-66fcc899-5198-41b3-81d4-26d58051237a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:36.443736 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-66fcc899-5198-41b3-81d4-26d58051237a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:36.449870 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:36.451526 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66fcc899-5198-41b3-81d4-26d58051237a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:36.452016 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66fcc899-5198-41b3-81d4-26d58051237a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:36.452481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66fcc899-5198-41b3-81d4-26d58051237a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:36.453195 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66fcc899-5198-41b3-81d4-26d58051237a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:36.453794 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66fcc899-5198-41b3-81d4-26d58051237a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:36.454228 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66fcc899-5198-41b3-81d4-26d58051237a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:36.514834 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-204086e0-00fd-467e-8727-83971f5b1f2c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:36.516347 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-204086e0-00fd-467e-8727-83971f5b1f2c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:36.523614 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-204086e0-00fd-467e-8727-83971f5b1f2c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:36.526775 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-204086e0-00fd-467e-8727-83971f5b1f2c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:36.527269 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-204086e0-00fd-467e-8727-83971f5b1f2c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:36.528581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-204086e0-00fd-467e-8727-83971f5b1f2c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:36.528581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-204086e0-00fd-467e-8727-83971f5b1f2c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:36.529084 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-204086e0-00fd-467e-8727-83971f5b1f2c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:36.610352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-66fcc899-5198-41b3-81d4-26d58051237a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lazy-loading 'services' on Instance uuid 62bd9290-c0f1-4e49-ac21-ffaad0578417 {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:36.687147 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-204086e0-00fd-467e-8727-83971f5b1f2c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:36.699204 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-204086e0-00fd-467e-8727-83971f5b1f2c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.189864 Oct 14 03:10:36.705410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 212/420] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:36 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:36.709287 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-58c976bf-70ad-4c42-b8ee-baf1db83fdee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:36.709887 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-58c976bf-70ad-4c42-b8ee-baf1db83fdee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:36.716859 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-58c976bf-70ad-4c42-b8ee-baf1db83fdee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:36.717897 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-58c976bf-70ad-4c42-b8ee-baf1db83fdee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:36.718511 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-58c976bf-70ad-4c42-b8ee-baf1db83fdee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:36.719214 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-58c976bf-70ad-4c42-b8ee-baf1db83fdee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:36.719664 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-58c976bf-70ad-4c42-b8ee-baf1db83fdee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:36.720081 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-58c976bf-70ad-4c42-b8ee-baf1db83fdee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:36.866058 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-58c976bf-70ad-4c42-b8ee-baf1db83fdee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:36.875103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-58c976bf-70ad-4c42-b8ee-baf1db83fdee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:36.876641 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-58c976bf-70ad-4c42-b8ee-baf1db83fdee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:36.877794 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-58c976bf-70ad-4c42-b8ee-baf1db83fdee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.176074 Oct 14 03:10:36.878351 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 213/421] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:36 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:36.883579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-16d1a9cc-81eb-41ab-91d0-16b016998be8 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:36.884182 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-16d1a9cc-81eb-41ab-91d0-16b016998be8 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:36.890115 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-16d1a9cc-81eb-41ab-91d0-16b016998be8 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:36.890610 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-16d1a9cc-81eb-41ab-91d0-16b016998be8 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:36.891012 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-16d1a9cc-81eb-41ab-91d0-16b016998be8 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:36.891696 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-16d1a9cc-81eb-41ab-91d0-16b016998be8 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:36.892150 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-16d1a9cc-81eb-41ab-91d0-16b016998be8 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:36.892601 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-16d1a9cc-81eb-41ab-91d0-16b016998be8 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:36.912694 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-66fcc899-5198-41b3-81d4-26d58051237a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "DELETE /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/os-volume_attachments/a24964a6-fd23-4163-9bce-96de5034508a" status: 202 len: 0 microversion: 2.1 time: 0.474510 Oct 14 03:10:36.917051 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 209/422] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Oct 14 03:10:36 2022] DELETE /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/os-volume_attachments/a24964a6-fd23-4163-9bce-96de5034508a => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:10:37.047152 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-16d1a9cc-81eb-41ab-91d0-16b016998be8 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:37.059791 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-16d1a9cc-81eb-41ab-91d0-16b016998be8 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.180286 Oct 14 03:10:37.060579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 214/423] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:36 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:37.547515 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-7fe94314-f629-44f2-9d68-552f02f911df req-6b8424e2-eaa1-4e18-b435-65fbb45af4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c3606f-b3fb-4249-b5fd-a2de8f5debc2", "name": "network-vif-plugged", "status": "completed", "tag": "fcb4f2b3-a43c-4d79-98f7-46d493d8d296"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:37.559023 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-7fe94314-f629-44f2-9d68-552f02f911df req-6b8424e2-eaa1-4e18-b435-65fbb45af4ab service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:37.559507 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-7fe94314-f629-44f2-9d68-552f02f911df req-6b8424e2-eaa1-4e18-b435-65fbb45af4ab service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:37.559941 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-7fe94314-f629-44f2-9d68-552f02f911df req-6b8424e2-eaa1-4e18-b435-65fbb45af4ab service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:37.570627 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-7fe94314-f629-44f2-9d68-552f02f911df req-6b8424e2-eaa1-4e18-b435-65fbb45af4ab service nova] Creating event network-vif-plugged:fcb4f2b3-a43c-4d79-98f7-46d493d8d296 for instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 on hv-cinder-80152 Oct 14 03:10:37.576177 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-7fe94314-f629-44f2-9d68-552f02f911df req-6b8424e2-eaa1-4e18-b435-65fbb45af4ab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032854 Oct 14 03:10:37.577257 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 210/424] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:37.723704 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5e1877d2-db2b-4599-83a0-6c5f1f17d73f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:37.725698 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5e1877d2-db2b-4599-83a0-6c5f1f17d73f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:37.732783 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5e1877d2-db2b-4599-83a0-6c5f1f17d73f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:37.733336 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5e1877d2-db2b-4599-83a0-6c5f1f17d73f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:37.733721 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5e1877d2-db2b-4599-83a0-6c5f1f17d73f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:37.734461 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5e1877d2-db2b-4599-83a0-6c5f1f17d73f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:37.735291 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5e1877d2-db2b-4599-83a0-6c5f1f17d73f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:37.735721 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5e1877d2-db2b-4599-83a0-6c5f1f17d73f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:37.754102 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=100 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:37.871742 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5e1877d2-db2b-4599-83a0-6c5f1f17d73f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:37.879821 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5e1877d2-db2b-4599-83a0-6c5f1f17d73f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.160593 Oct 14 03:10:37.880626 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 215/425] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:37 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:37.905132 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b294af2f-7f83-4247-95d3-970dcbf4b3c8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:37.908821 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b294af2f-7f83-4247-95d3-970dcbf4b3c8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:37.912783 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b294af2f-7f83-4247-95d3-970dcbf4b3c8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:37.913334 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b294af2f-7f83-4247-95d3-970dcbf4b3c8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:37.913835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b294af2f-7f83-4247-95d3-970dcbf4b3c8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:37.914588 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b294af2f-7f83-4247-95d3-970dcbf4b3c8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:37.915108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b294af2f-7f83-4247-95d3-970dcbf4b3c8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:37.915598 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b294af2f-7f83-4247-95d3-970dcbf4b3c8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:37.918456 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:38.059237 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b294af2f-7f83-4247-95d3-970dcbf4b3c8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:38.069859 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b294af2f-7f83-4247-95d3-970dcbf4b3c8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:38.071625 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b294af2f-7f83-4247-95d3-970dcbf4b3c8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:38.073399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b294af2f-7f83-4247-95d3-970dcbf4b3c8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.172755 Oct 14 03:10:38.074134 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 211/426] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:37 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:38.096673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e734f61e-1889-4115-b00d-2b224c800c0a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:38.097784 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e734f61e-1889-4115-b00d-2b224c800c0a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:38.105160 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e734f61e-1889-4115-b00d-2b224c800c0a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:38.105738 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e734f61e-1889-4115-b00d-2b224c800c0a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:38.106245 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e734f61e-1889-4115-b00d-2b224c800c0a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:38.107124 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e734f61e-1889-4115-b00d-2b224c800c0a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:38.107667 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e734f61e-1889-4115-b00d-2b224c800c0a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:38.108226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e734f61e-1889-4115-b00d-2b224c800c0a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:38.248570 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-e734f61e-1889-4115-b00d-2b224c800c0a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:38.257106 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e734f61e-1889-4115-b00d-2b224c800c0a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.166690 Oct 14 03:10:38.257684 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 216/427] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:38 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:38.907177 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f03d6177-9c45-4bab-8be0-26e3a84318d8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:38.907924 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f03d6177-9c45-4bab-8be0-26e3a84318d8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:38.914956 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f03d6177-9c45-4bab-8be0-26e3a84318d8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:38.915429 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f03d6177-9c45-4bab-8be0-26e3a84318d8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:38.915857 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f03d6177-9c45-4bab-8be0-26e3a84318d8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:38.916574 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f03d6177-9c45-4bab-8be0-26e3a84318d8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:38.917024 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f03d6177-9c45-4bab-8be0-26e3a84318d8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:38.917480 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f03d6177-9c45-4bab-8be0-26e3a84318d8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:39.061290 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-f03d6177-9c45-4bab-8be0-26e3a84318d8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:39.070564 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f03d6177-9c45-4bab-8be0-26e3a84318d8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.166993 Oct 14 03:10:39.086919 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 212/428] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:38 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:39.107042 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5b0996eb-71cb-4671-b6da-f224dae57c7b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:39.107683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5b0996eb-71cb-4671-b6da-f224dae57c7b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:39.114823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5b0996eb-71cb-4671-b6da-f224dae57c7b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:39.115322 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5b0996eb-71cb-4671-b6da-f224dae57c7b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:39.115764 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5b0996eb-71cb-4671-b6da-f224dae57c7b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:39.116491 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5b0996eb-71cb-4671-b6da-f224dae57c7b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:39.116952 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5b0996eb-71cb-4671-b6da-f224dae57c7b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:39.117384 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5b0996eb-71cb-4671-b6da-f224dae57c7b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:39.258385 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5b0996eb-71cb-4671-b6da-f224dae57c7b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:39.267190 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5b0996eb-71cb-4671-b6da-f224dae57c7b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:39.268716 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5b0996eb-71cb-4671-b6da-f224dae57c7b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:39.271587 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5b0996eb-71cb-4671-b6da-f224dae57c7b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.168439 Oct 14 03:10:39.272757 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 217/429] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:39 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:39.280920 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-657ea4c7-0750-49ca-8777-86c198d891dc tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:39.281600 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-657ea4c7-0750-49ca-8777-86c198d891dc tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:39.289364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-657ea4c7-0750-49ca-8777-86c198d891dc tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:39.289994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-657ea4c7-0750-49ca-8777-86c198d891dc tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:39.290445 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-657ea4c7-0750-49ca-8777-86c198d891dc tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:39.291286 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-657ea4c7-0750-49ca-8777-86c198d891dc tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:39.292097 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-657ea4c7-0750-49ca-8777-86c198d891dc tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:39.292312 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-657ea4c7-0750-49ca-8777-86c198d891dc tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:39.450448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-657ea4c7-0750-49ca-8777-86c198d891dc tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:39.450448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-657ea4c7-0750-49ca-8777-86c198d891dc tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.162945 Oct 14 03:10:39.450448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 213/430] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:39 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:40.094215 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-593d6af2-0f44-4369-9c08-4cb4774779ac tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:40.094839 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-593d6af2-0f44-4369-9c08-4cb4774779ac tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:40.101286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-593d6af2-0f44-4369-9c08-4cb4774779ac tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:40.101782 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-593d6af2-0f44-4369-9c08-4cb4774779ac tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:40.102227 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-593d6af2-0f44-4369-9c08-4cb4774779ac tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:40.102940 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-593d6af2-0f44-4369-9c08-4cb4774779ac tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:40.103402 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-593d6af2-0f44-4369-9c08-4cb4774779ac tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:40.103832 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-593d6af2-0f44-4369-9c08-4cb4774779ac tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:40.276833 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-593d6af2-0f44-4369-9c08-4cb4774779ac tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:40.284673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-593d6af2-0f44-4369-9c08-4cb4774779ac tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.194376 Oct 14 03:10:40.285257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 218/431] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:40 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:40.297946 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a66e0f71-1a47-4595-8c20-1ca5a68fd16f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:40.298729 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-a66e0f71-1a47-4595-8c20-1ca5a68fd16f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:40.306151 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a66e0f71-1a47-4595-8c20-1ca5a68fd16f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:40.306718 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a66e0f71-1a47-4595-8c20-1ca5a68fd16f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:40.307185 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a66e0f71-1a47-4595-8c20-1ca5a68fd16f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:40.307883 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a66e0f71-1a47-4595-8c20-1ca5a68fd16f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:40.308333 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a66e0f71-1a47-4595-8c20-1ca5a68fd16f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:40.308835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a66e0f71-1a47-4595-8c20-1ca5a68fd16f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:40.449016 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a66e0f71-1a47-4595-8c20-1ca5a68fd16f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:40.459945 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a66e0f71-1a47-4595-8c20-1ca5a68fd16f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:40.461489 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a66e0f71-1a47-4595-8c20-1ca5a68fd16f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:40.462747 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-a66e0f71-1a47-4595-8c20-1ca5a68fd16f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.168627 Oct 14 03:10:40.463657 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 214/432] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:40 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:40.477805 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0dbcec0a-87d3-426c-8338-c44a118351a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:40.482671 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0dbcec0a-87d3-426c-8338-c44a118351a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:40.490106 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0dbcec0a-87d3-426c-8338-c44a118351a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:40.490687 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0dbcec0a-87d3-426c-8338-c44a118351a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:40.491139 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0dbcec0a-87d3-426c-8338-c44a118351a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:40.491863 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0dbcec0a-87d3-426c-8338-c44a118351a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:40.492322 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0dbcec0a-87d3-426c-8338-c44a118351a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:40.492779 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0dbcec0a-87d3-426c-8338-c44a118351a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:40.634895 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0dbcec0a-87d3-426c-8338-c44a118351a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:40.642589 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0dbcec0a-87d3-426c-8338-c44a118351a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.168756 Oct 14 03:10:40.643153 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 219/433] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:40 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:41.311823 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b486f406-1328-4d98-a422-56558b6c9c66 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:41.312444 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b486f406-1328-4d98-a422-56558b6c9c66 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:41.318806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b486f406-1328-4d98-a422-56558b6c9c66 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:41.319283 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b486f406-1328-4d98-a422-56558b6c9c66 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:41.319718 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b486f406-1328-4d98-a422-56558b6c9c66 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:41.320421 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b486f406-1328-4d98-a422-56558b6c9c66 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:41.320875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b486f406-1328-4d98-a422-56558b6c9c66 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:41.321297 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b486f406-1328-4d98-a422-56558b6c9c66 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:41.455296 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b486f406-1328-4d98-a422-56558b6c9c66 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:41.463595 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b486f406-1328-4d98-a422-56558b6c9c66 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.155572 Oct 14 03:10:41.464363 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 215/434] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:41 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:41.487696 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3f2619c8-1454-46b0-93cd-4bd7511eba23 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:41.488317 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3f2619c8-1454-46b0-93cd-4bd7511eba23 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:41.494906 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3f2619c8-1454-46b0-93cd-4bd7511eba23 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:41.495393 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3f2619c8-1454-46b0-93cd-4bd7511eba23 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:41.495827 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3f2619c8-1454-46b0-93cd-4bd7511eba23 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:41.496561 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3f2619c8-1454-46b0-93cd-4bd7511eba23 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:41.497014 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3f2619c8-1454-46b0-93cd-4bd7511eba23 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:41.497436 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3f2619c8-1454-46b0-93cd-4bd7511eba23 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:41.633190 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3f2619c8-1454-46b0-93cd-4bd7511eba23 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:41.642386 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3f2619c8-1454-46b0-93cd-4bd7511eba23 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:41.643828 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3f2619c8-1454-46b0-93cd-4bd7511eba23 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:41.645568 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3f2619c8-1454-46b0-93cd-4bd7511eba23 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.161703 Oct 14 03:10:41.646308 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 220/435] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:41 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:41.668861 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d6e96817-adb2-451d-a47b-c4ff32c301d4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:41.679854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d6e96817-adb2-451d-a47b-c4ff32c301d4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:41.679854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d6e96817-adb2-451d-a47b-c4ff32c301d4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:41.679854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d6e96817-adb2-451d-a47b-c4ff32c301d4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:41.679854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d6e96817-adb2-451d-a47b-c4ff32c301d4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:41.680922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d6e96817-adb2-451d-a47b-c4ff32c301d4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:41.680922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d6e96817-adb2-451d-a47b-c4ff32c301d4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:41.680922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d6e96817-adb2-451d-a47b-c4ff32c301d4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:41.811738 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-d6e96817-adb2-451d-a47b-c4ff32c301d4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:41.825794 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d6e96817-adb2-451d-a47b-c4ff32c301d4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.160427 Oct 14 03:10:41.826603 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 216/436] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:41 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:42.487208 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f1fa69f5-62d5-450e-a9c1-27b7638ac953 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:42.489168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f1fa69f5-62d5-450e-a9c1-27b7638ac953 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:42.503400 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f1fa69f5-62d5-450e-a9c1-27b7638ac953 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:42.503400 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f1fa69f5-62d5-450e-a9c1-27b7638ac953 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:42.503400 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f1fa69f5-62d5-450e-a9c1-27b7638ac953 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:42.503400 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f1fa69f5-62d5-450e-a9c1-27b7638ac953 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:42.503884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f1fa69f5-62d5-450e-a9c1-27b7638ac953 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:42.503884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f1fa69f5-62d5-450e-a9c1-27b7638ac953 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:42.638948 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f1fa69f5-62d5-450e-a9c1-27b7638ac953 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:42.646857 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f1fa69f5-62d5-450e-a9c1-27b7638ac953 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.163782 Oct 14 03:10:42.647473 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 221/437] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:42 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:42.671210 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-5fbd728d-01ed-4dbe-8d60-8e97a03420a6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:42.671888 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-5fbd728d-01ed-4dbe-8d60-8e97a03420a6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:42.680265 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5fbd728d-01ed-4dbe-8d60-8e97a03420a6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:42.680803 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5fbd728d-01ed-4dbe-8d60-8e97a03420a6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:42.681242 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5fbd728d-01ed-4dbe-8d60-8e97a03420a6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:42.681952 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5fbd728d-01ed-4dbe-8d60-8e97a03420a6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:42.682452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5fbd728d-01ed-4dbe-8d60-8e97a03420a6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:42.682937 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5fbd728d-01ed-4dbe-8d60-8e97a03420a6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:42.823949 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5fbd728d-01ed-4dbe-8d60-8e97a03420a6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:42.833017 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5fbd728d-01ed-4dbe-8d60-8e97a03420a6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:42.834468 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5fbd728d-01ed-4dbe-8d60-8e97a03420a6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:42.835625 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-5fbd728d-01ed-4dbe-8d60-8e97a03420a6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.168330 Oct 14 03:10:42.836186 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 217/438] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:42 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:42.849461 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-26685713-736e-47d8-abe0-b7c114a41740 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:42.850080 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-26685713-736e-47d8-abe0-b7c114a41740 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:42.856480 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-26685713-736e-47d8-abe0-b7c114a41740 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:42.862536 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-26685713-736e-47d8-abe0-b7c114a41740 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:42.862536 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-26685713-736e-47d8-abe0-b7c114a41740 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:42.862536 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-26685713-736e-47d8-abe0-b7c114a41740 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:42.862536 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-26685713-736e-47d8-abe0-b7c114a41740 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:42.863137 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-26685713-736e-47d8-abe0-b7c114a41740 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:42.999028 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-26685713-736e-47d8-abe0-b7c114a41740 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:42.999874 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-26685713-736e-47d8-abe0-b7c114a41740 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.154642 Oct 14 03:10:43.000910 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 222/439] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:42 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:43.671868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0b0b53dd-695c-4387-bc53-5224e816f67e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:43.672421 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-0b0b53dd-695c-4387-bc53-5224e816f67e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:43.679719 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0b0b53dd-695c-4387-bc53-5224e816f67e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:43.680241 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0b0b53dd-695c-4387-bc53-5224e816f67e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:43.680732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0b0b53dd-695c-4387-bc53-5224e816f67e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:43.684937 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0b0b53dd-695c-4387-bc53-5224e816f67e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:43.684937 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0b0b53dd-695c-4387-bc53-5224e816f67e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:43.684937 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0b0b53dd-695c-4387-bc53-5224e816f67e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:43.810902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-0b0b53dd-695c-4387-bc53-5224e816f67e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:43.818988 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-0b0b53dd-695c-4387-bc53-5224e816f67e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.153014 Oct 14 03:10:43.819559 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 218/440] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:43 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:43.861476 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-4538c4a1-1efe-4aa3-94c4-7810ac64dd25 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:43.862086 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-4538c4a1-1efe-4aa3-94c4-7810ac64dd25 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:43.869121 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4538c4a1-1efe-4aa3-94c4-7810ac64dd25 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:43.869604 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4538c4a1-1efe-4aa3-94c4-7810ac64dd25 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:43.870043 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4538c4a1-1efe-4aa3-94c4-7810ac64dd25 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:43.870733 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4538c4a1-1efe-4aa3-94c4-7810ac64dd25 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:43.871186 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4538c4a1-1efe-4aa3-94c4-7810ac64dd25 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:43.871609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4538c4a1-1efe-4aa3-94c4-7810ac64dd25 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:43.996585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4538c4a1-1efe-4aa3-94c4-7810ac64dd25 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:44.005758 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4538c4a1-1efe-4aa3-94c4-7810ac64dd25 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:44.007217 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4538c4a1-1efe-4aa3-94c4-7810ac64dd25 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:44.008394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-4538c4a1-1efe-4aa3-94c4-7810ac64dd25 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.150757 Oct 14 03:10:44.008948 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 223/441] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:43 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:44.022826 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0d6aa71c-0c5d-4fab-aa14-bb57dce534ef tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:44.023564 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-0d6aa71c-0c5d-4fab-aa14-bb57dce534ef tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:44.029528 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0d6aa71c-0c5d-4fab-aa14-bb57dce534ef tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:44.030002 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0d6aa71c-0c5d-4fab-aa14-bb57dce534ef tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:44.030432 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0d6aa71c-0c5d-4fab-aa14-bb57dce534ef tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:44.031109 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0d6aa71c-0c5d-4fab-aa14-bb57dce534ef tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:44.031556 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0d6aa71c-0c5d-4fab-aa14-bb57dce534ef tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:44.031973 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0d6aa71c-0c5d-4fab-aa14-bb57dce534ef tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:44.159212 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-0d6aa71c-0c5d-4fab-aa14-bb57dce534ef tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:44.167564 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-0d6aa71c-0c5d-4fab-aa14-bb57dce534ef tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.148509 Oct 14 03:10:44.168139 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 219/442] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:44 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:44.841724 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e1f5970f-3bb7-4a5d-a66d-dcd0aa361240 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:44.842335 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e1f5970f-3bb7-4a5d-a66d-dcd0aa361240 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:44.848441 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e1f5970f-3bb7-4a5d-a66d-dcd0aa361240 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:44.848927 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e1f5970f-3bb7-4a5d-a66d-dcd0aa361240 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:44.849362 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e1f5970f-3bb7-4a5d-a66d-dcd0aa361240 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:44.850049 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e1f5970f-3bb7-4a5d-a66d-dcd0aa361240 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:44.850498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e1f5970f-3bb7-4a5d-a66d-dcd0aa361240 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:44.850919 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e1f5970f-3bb7-4a5d-a66d-dcd0aa361240 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:44.974842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-e1f5970f-3bb7-4a5d-a66d-dcd0aa361240 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:44.982423 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e1f5970f-3bb7-4a5d-a66d-dcd0aa361240 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.144561 Oct 14 03:10:44.982990 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 224/443] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:44 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:45.033674 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b4a60448-94b5-41e4-8394-9a27db06df6f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:45.034278 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b4a60448-94b5-41e4-8394-9a27db06df6f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:45.041393 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b4a60448-94b5-41e4-8394-9a27db06df6f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:45.041882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b4a60448-94b5-41e4-8394-9a27db06df6f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:45.042320 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b4a60448-94b5-41e4-8394-9a27db06df6f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:45.043034 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b4a60448-94b5-41e4-8394-9a27db06df6f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:45.043570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b4a60448-94b5-41e4-8394-9a27db06df6f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:45.043998 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b4a60448-94b5-41e4-8394-9a27db06df6f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:45.193062 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-247f361c-236a-492e-a0a4-f565bcac26f1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:45.194845 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-247f361c-236a-492e-a0a4-f565bcac26f1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:45.203092 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-247f361c-236a-492e-a0a4-f565bcac26f1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:45.203861 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-247f361c-236a-492e-a0a4-f565bcac26f1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:45.204704 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-247f361c-236a-492e-a0a4-f565bcac26f1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:45.207626 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-247f361c-236a-492e-a0a4-f565bcac26f1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:45.208081 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b4a60448-94b5-41e4-8394-9a27db06df6f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:45.208712 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-247f361c-236a-492e-a0a4-f565bcac26f1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:45.208712 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-247f361c-236a-492e-a0a4-f565bcac26f1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:45.215819 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b4a60448-94b5-41e4-8394-9a27db06df6f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:45.217455 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b4a60448-94b5-41e4-8394-9a27db06df6f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:45.218627 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b4a60448-94b5-41e4-8394-9a27db06df6f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.189858 Oct 14 03:10:45.219196 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 220/444] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:45 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:45.340080 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-247f361c-236a-492e-a0a4-f565bcac26f1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:45.347650 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-247f361c-236a-492e-a0a4-f565bcac26f1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.159571 Oct 14 03:10:45.348217 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 225/445] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:45 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:45.878143 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-1ad08610-31a9-48ac-a96d-213c5379ca7f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:45.878638 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-1ad08610-31a9-48ac-a96d-213c5379ca7f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:45.884488 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1ad08610-31a9-48ac-a96d-213c5379ca7f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:45.885090 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1ad08610-31a9-48ac-a96d-213c5379ca7f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:45.885527 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1ad08610-31a9-48ac-a96d-213c5379ca7f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:45.886215 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1ad08610-31a9-48ac-a96d-213c5379ca7f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:45.886673 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1ad08610-31a9-48ac-a96d-213c5379ca7f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:45.887101 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1ad08610-31a9-48ac-a96d-213c5379ca7f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:45.909465 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-1ad08610-31a9-48ac-a96d-213c5379ca7f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924/ips" status: 200 len: 150 microversion: 2.1 time: 0.035172 Oct 14 03:10:45.910003 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 221/446] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Oct 14 03:10:45 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:45.923102 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e90170f8-6be3-4558-8008-1fd8dafe7155 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d9ea303-3b32-4e79-9633-1de971d83f37"}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:45.925611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e90170f8-6be3-4558-8008-1fd8dafe7155 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:45.932651 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e90170f8-6be3-4558-8008-1fd8dafe7155 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:45.933139 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e90170f8-6be3-4558-8008-1fd8dafe7155 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:45.933578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e90170f8-6be3-4558-8008-1fd8dafe7155 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:45.934269 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e90170f8-6be3-4558-8008-1fd8dafe7155 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:45.934723 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e90170f8-6be3-4558-8008-1fd8dafe7155 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:45.935149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e90170f8-6be3-4558-8008-1fd8dafe7155 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.004041 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-afb5b223-0178-40d3-8378-07c97424336b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:46.004768 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-afb5b223-0178-40d3-8378-07c97424336b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:46.010671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-afb5b223-0178-40d3-8378-07c97424336b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.011152 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-afb5b223-0178-40d3-8378-07c97424336b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.011589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-afb5b223-0178-40d3-8378-07c97424336b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.012285 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-afb5b223-0178-40d3-8378-07c97424336b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.012771 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-afb5b223-0178-40d3-8378-07c97424336b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.013198 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-afb5b223-0178-40d3-8378-07c97424336b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.013304 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-e90170f8-6be3-4558-8008-1fd8dafe7155 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] HTTP exception thrown: Invalid volume: volume 4d9ea303-3b32-4e79-9633-1de971d83f37 is already attached to instances: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e90170f8-6be3-4558-8008-1fd8dafe7155 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Request method failure captured: Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: POST /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924/os-volume_attachments HTTP/1.1 Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 74 Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNKG-ky05sope_YdGjGweAljK5FUxzsY0TE3JqS7jM4jPzALKbCEnItlHGzo5Xg-IOfB8MCgv3mdaVNqvdBnmYZMENHyFWRo7_9tNs76BHsJnl6Osbo5VySDApF7HiliGWSEh0OSOTvdEIMsVWp5oVBM2GccEYCsyuR5X3gKYrX8g9g Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:10:46.015361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:10:46.016744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:10:46.016744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:10:46.016744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:10:46.016744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:10:46.016744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:10:46.016744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:10:46.016744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:10:46.016744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 4553b7573ca34af6a9fdb94f80717f24 Oct 14 03:10:46.016744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:10:46.016744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Oct 14 03:10:46.016744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {"volumeAttachment": {"volumeId": "4d9ea303-3b32-4e79-9633-1de971d83f37"}} Oct 14 03:10:46.016744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Invalid volume: volume 4d9ea303-3b32-4e79-9633-1de971d83f37 is already attached to instances: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'server_id': 'f165841c-8922-4baa-909d-daf6b2e6b924', 'body': {'volumeAttachment': {'volumeId': '4d9ea303-3b32-4e79-9633-1de971d83f37'}}} Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4d9ea303-3b32-4e79-9633-1de971d83f37 is already attached to instances: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:10:46.017985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4d9ea303-3b32-4e79-9633-1de971d83f37 is already attached to instances: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:46.019534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:10:46.022717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:10:46.022717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:10:46.022717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:10:46.022717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4d9ea303-3b32-4e79-9633-1de971d83f37 is already attached to instances: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d Oct 14 03:10:46.022717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:10:46.022717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e90170f8-6be3-4558-8008-1fd8dafe7155 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Returning 400 to user: Invalid volume: volume 4d9ea303-3b32-4e79-9633-1de971d83f37 is already attached to instances: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:10:46.022717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e90170f8-6be3-4558-8008-1fd8dafe7155 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "POST /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097711 Oct 14 03:10:46.022717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 226/447] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Oct 14 03:10:45 2022] POST /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:10:46.026167 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-01e7e964-5b36-480b-9328-f7ddf0d6976e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:46.026831 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-01e7e964-5b36-480b-9328-f7ddf0d6976e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:46.036415 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-01e7e964-5b36-480b-9328-f7ddf0d6976e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.037025 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-01e7e964-5b36-480b-9328-f7ddf0d6976e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.037459 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-01e7e964-5b36-480b-9328-f7ddf0d6976e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.038153 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-01e7e964-5b36-480b-9328-f7ddf0d6976e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.038603 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-01e7e964-5b36-480b-9328-f7ddf0d6976e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.039024 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-01e7e964-5b36-480b-9328-f7ddf0d6976e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.063303 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-01e7e964-5b36-480b-9328-f7ddf0d6976e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Going to try to terminate instance {{(pid=119301) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:10:46.140772 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-afb5b223-0178-40d3-8378-07c97424336b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:46.148907 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-afb5b223-0178-40d3-8378-07c97424336b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.148645 Oct 14 03:10:46.150627 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 222/448] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:45 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:46.243303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a50d3c36-29eb-4328-b5e8-2b0c490b8265 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:46.243912 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-a50d3c36-29eb-4328-b5e8-2b0c490b8265 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:46.249740 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a50d3c36-29eb-4328-b5e8-2b0c490b8265 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.250223 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a50d3c36-29eb-4328-b5e8-2b0c490b8265 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.250659 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a50d3c36-29eb-4328-b5e8-2b0c490b8265 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.251350 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a50d3c36-29eb-4328-b5e8-2b0c490b8265 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.251810 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a50d3c36-29eb-4328-b5e8-2b0c490b8265 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.252240 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a50d3c36-29eb-4328-b5e8-2b0c490b8265 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.367837 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-01e7e964-5b36-480b-9328-f7ddf0d6976e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 204 len: 0 microversion: 2.1 time: 0.345023 Oct 14 03:10:46.368487 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 227/449] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:10:46 2022] DELETE /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 03:10:46.373580 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-386ad7cb-6515-47d0-a014-4a3baf3b11ab tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:46.375832 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-386ad7cb-6515-47d0-a014-4a3baf3b11ab tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:46.380821 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-386ad7cb-6515-47d0-a014-4a3baf3b11ab tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.381309 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-386ad7cb-6515-47d0-a014-4a3baf3b11ab tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.381464 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a50d3c36-29eb-4328-b5e8-2b0c490b8265 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:46.381747 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-386ad7cb-6515-47d0-a014-4a3baf3b11ab tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.382619 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-386ad7cb-6515-47d0-a014-4a3baf3b11ab tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.383009 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-386ad7cb-6515-47d0-a014-4a3baf3b11ab tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.383435 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-386ad7cb-6515-47d0-a014-4a3baf3b11ab tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.390104 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a50d3c36-29eb-4328-b5e8-2b0c490b8265 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:46.391493 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a50d3c36-29eb-4328-b5e8-2b0c490b8265 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:46.392693 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-a50d3c36-29eb-4328-b5e8-2b0c490b8265 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.153281 Oct 14 03:10:46.393252 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 223/450] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:46 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:46.411190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8c7a2600-e315-4aa0-919c-3b20f848d47b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:46.411190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8c7a2600-e315-4aa0-919c-3b20f848d47b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:46.411190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8c7a2600-e315-4aa0-919c-3b20f848d47b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.411190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8c7a2600-e315-4aa0-919c-3b20f848d47b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.411599 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8c7a2600-e315-4aa0-919c-3b20f848d47b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.411599 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8c7a2600-e315-4aa0-919c-3b20f848d47b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.411599 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8c7a2600-e315-4aa0-919c-3b20f848d47b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.411599 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8c7a2600-e315-4aa0-919c-3b20f848d47b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.570981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-386ad7cb-6515-47d0-a014-4a3baf3b11ab tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:46.578890 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-386ad7cb-6515-47d0-a014-4a3baf3b11ab tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.209280 Oct 14 03:10:46.579477 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 228/451] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:46 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:46.588293 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8c7a2600-e315-4aa0-919c-3b20f848d47b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:46.596196 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8c7a2600-e315-4aa0-919c-3b20f848d47b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1680 microversion: 2.1 time: 0.201917 Oct 14 03:10:46.596730 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 224/452] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:46 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:47.171896 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b0e9496f-ecd0-4203-81d9-e321605a3cd3 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:47.172539 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b0e9496f-ecd0-4203-81d9-e321605a3cd3 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:47.180099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b0e9496f-ecd0-4203-81d9-e321605a3cd3 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:47.180618 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b0e9496f-ecd0-4203-81d9-e321605a3cd3 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:47.184548 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b0e9496f-ecd0-4203-81d9-e321605a3cd3 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:47.184548 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b0e9496f-ecd0-4203-81d9-e321605a3cd3 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:47.184548 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b0e9496f-ecd0-4203-81d9-e321605a3cd3 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:47.184548 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b0e9496f-ecd0-4203-81d9-e321605a3cd3 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:47.309599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b0e9496f-ecd0-4203-81d9-e321605a3cd3 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:47.317185 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b0e9496f-ecd0-4203-81d9-e321605a3cd3 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.149253 Oct 14 03:10:47.317741 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 229/453] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:47 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:47.420847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-bbe188cc-1cf1-4630-bed3-30e40f3b5045 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:47.422961 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-bbe188cc-1cf1-4630-bed3-30e40f3b5045 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:47.428469 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bbe188cc-1cf1-4630-bed3-30e40f3b5045 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:47.428975 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bbe188cc-1cf1-4630-bed3-30e40f3b5045 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:47.429409 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bbe188cc-1cf1-4630-bed3-30e40f3b5045 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:47.430089 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bbe188cc-1cf1-4630-bed3-30e40f3b5045 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:47.430535 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bbe188cc-1cf1-4630-bed3-30e40f3b5045 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:47.430953 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bbe188cc-1cf1-4630-bed3-30e40f3b5045 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:47.562990 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-bbe188cc-1cf1-4630-bed3-30e40f3b5045 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:47.571551 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-bbe188cc-1cf1-4630-bed3-30e40f3b5045 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:47.573075 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-bbe188cc-1cf1-4630-bed3-30e40f3b5045 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:47.575095 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-bbe188cc-1cf1-4630-bed3-30e40f3b5045 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.158138 Oct 14 03:10:47.576478 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 225/454] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:47 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:47.602672 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-6f20dbb3-0a4a-4624-bac4-deb2a2281dc1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:47.603208 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-6f20dbb3-0a4a-4624-bac4-deb2a2281dc1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:47.609163 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6f20dbb3-0a4a-4624-bac4-deb2a2281dc1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:47.609639 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6f20dbb3-0a4a-4624-bac4-deb2a2281dc1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:47.610072 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6f20dbb3-0a4a-4624-bac4-deb2a2281dc1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:47.610751 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6f20dbb3-0a4a-4624-bac4-deb2a2281dc1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:47.611199 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6f20dbb3-0a4a-4624-bac4-deb2a2281dc1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:47.611615 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6f20dbb3-0a4a-4624-bac4-deb2a2281dc1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:47.618798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-4f21ec53-593c-49e5-8e32-a0b1d04f97ec tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:47.619412 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-4f21ec53-593c-49e5-8e32-a0b1d04f97ec tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:47.625208 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4f21ec53-593c-49e5-8e32-a0b1d04f97ec tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:47.625689 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4f21ec53-593c-49e5-8e32-a0b1d04f97ec tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:47.626125 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4f21ec53-593c-49e5-8e32-a0b1d04f97ec tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:47.626873 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4f21ec53-593c-49e5-8e32-a0b1d04f97ec tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:47.627317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4f21ec53-593c-49e5-8e32-a0b1d04f97ec tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:47.627746 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4f21ec53-593c-49e5-8e32-a0b1d04f97ec tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:47.629609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:47.808705 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-6f20dbb3-0a4a-4624-bac4-deb2a2281dc1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:47.818311 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-6f20dbb3-0a4a-4624-bac4-deb2a2281dc1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.220031 Oct 14 03:10:47.822815 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4f21ec53-593c-49e5-8e32-a0b1d04f97ec tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:47.832985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 230/455] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:47 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:47.835147 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-4f21ec53-593c-49e5-8e32-a0b1d04f97ec tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1680 microversion: 2.1 time: 0.219968 Oct 14 03:10:47.835904 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 226/456] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:47 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:48.339943 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-bf73918e-999a-4f1c-a76c-1a0cd5e117e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:48.340581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-bf73918e-999a-4f1c-a76c-1a0cd5e117e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:48.346884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bf73918e-999a-4f1c-a76c-1a0cd5e117e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.347359 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bf73918e-999a-4f1c-a76c-1a0cd5e117e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.347787 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bf73918e-999a-4f1c-a76c-1a0cd5e117e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.348497 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bf73918e-999a-4f1c-a76c-1a0cd5e117e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.348947 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bf73918e-999a-4f1c-a76c-1a0cd5e117e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.349366 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bf73918e-999a-4f1c-a76c-1a0cd5e117e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.475530 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-bf73918e-999a-4f1c-a76c-1a0cd5e117e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:48.483244 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-bf73918e-999a-4f1c-a76c-1a0cd5e117e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.147075 Oct 14 03:10:48.483822 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 231/457] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:48 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:48.602409 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-24277521-afee-4032-bf88-a4c004baa6a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:48.603026 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-24277521-afee-4032-bf88-a4c004baa6a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:48.609906 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24277521-afee-4032-bf88-a4c004baa6a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.610406 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24277521-afee-4032-bf88-a4c004baa6a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.610826 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24277521-afee-4032-bf88-a4c004baa6a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.611599 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24277521-afee-4032-bf88-a4c004baa6a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.611978 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24277521-afee-4032-bf88-a4c004baa6a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.612412 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24277521-afee-4032-bf88-a4c004baa6a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.662344 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-dbcb6cb9-42ce-40ff-94e1-afbd3206e0d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:48.668620 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dbcb6cb9-42ce-40ff-94e1-afbd3206e0d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.669106 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dbcb6cb9-42ce-40ff-94e1-afbd3206e0d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.669541 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dbcb6cb9-42ce-40ff-94e1-afbd3206e0d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.692655 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-dbcb6cb9-42ce-40ff-94e1-afbd3206e0d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Going to try to stop instance {{(pid=119301) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 14 03:10:48.745372 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-24277521-afee-4032-bf88-a4c004baa6a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:48.754264 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-24277521-afee-4032-bf88-a4c004baa6a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:48.755699 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-24277521-afee-4032-bf88-a4c004baa6a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:48.756879 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-24277521-afee-4032-bf88-a4c004baa6a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.159220 Oct 14 03:10:48.757470 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 227/458] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:48 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:48.841710 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c6f5d518-3e90-4d2b-b4cc-5f55b52fc468 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:48.842313 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c6f5d518-3e90-4d2b-b4cc-5f55b52fc468 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:48.848715 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c6f5d518-3e90-4d2b-b4cc-5f55b52fc468 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.849191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c6f5d518-3e90-4d2b-b4cc-5f55b52fc468 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.849957 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c6f5d518-3e90-4d2b-b4cc-5f55b52fc468 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.850703 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c6f5d518-3e90-4d2b-b4cc-5f55b52fc468 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.851219 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c6f5d518-3e90-4d2b-b4cc-5f55b52fc468 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.851642 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c6f5d518-3e90-4d2b-b4cc-5f55b52fc468 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.856382 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-dbcb6cb9-42ce-40ff-94e1-afbd3206e0d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "POST /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/action" status: 202 len: 0 microversion: 2.1 time: 0.198491 Oct 14 03:10:48.856722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=100 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:48.862249 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 232/459] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Oct 14 03:10:48 2022] POST /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:10:48.862249 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1f1d6860-45e1-4d37-8b9c-97823bd779dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:48.862612 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1f1d6860-45e1-4d37-8b9c-97823bd779dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:48.869269 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1f1d6860-45e1-4d37-8b9c-97823bd779dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.869747 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1f1d6860-45e1-4d37-8b9c-97823bd779dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.870198 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1f1d6860-45e1-4d37-8b9c-97823bd779dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.870862 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1f1d6860-45e1-4d37-8b9c-97823bd779dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.871308 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1f1d6860-45e1-4d37-8b9c-97823bd779dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.871725 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1f1d6860-45e1-4d37-8b9c-97823bd779dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:49.052441 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c6f5d518-3e90-4d2b-b4cc-5f55b52fc468 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:49.057108 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1f1d6860-45e1-4d37-8b9c-97823bd779dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:49.061436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c6f5d518-3e90-4d2b-b4cc-5f55b52fc468 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.223885 Oct 14 03:10:49.062349 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 228/460] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:48 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:49.064988 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1f1d6860-45e1-4d37-8b9c-97823bd779dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1680 microversion: 2.1 time: 0.206844 Oct 14 03:10:49.072457 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 233/461] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:48 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1680 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:49.072650 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a68b3a8d-c5c9-4769-ab9a-d8def96d63c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:49.072650 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-a68b3a8d-c5c9-4769-ab9a-d8def96d63c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:49.079067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a68b3a8d-c5c9-4769-ab9a-d8def96d63c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:49.079219 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a68b3a8d-c5c9-4769-ab9a-d8def96d63c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:49.085803 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a68b3a8d-c5c9-4769-ab9a-d8def96d63c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:49.085803 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a68b3a8d-c5c9-4769-ab9a-d8def96d63c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:49.085803 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a68b3a8d-c5c9-4769-ab9a-d8def96d63c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:49.085803 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a68b3a8d-c5c9-4769-ab9a-d8def96d63c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:49.229803 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a68b3a8d-c5c9-4769-ab9a-d8def96d63c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:49.241863 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-a68b3a8d-c5c9-4769-ab9a-d8def96d63c4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1677 microversion: 2.1 time: 0.174129 Oct 14 03:10:49.242782 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 229/462] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:49 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:49.417941 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-ca7db430-9bcf-4c3b-a04a-d2b886249080 req-bca4c9a4-3d8f-4853-bce2-f38628b39633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866d9750-81fa-4eba-a3b7-b1c1182ed24d", "name": "network-vif-plugged", "status": "completed", "tag": "846e0443-12a3-4f37-a28b-a559f43fd6b4"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:49.428577 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-ca7db430-9bcf-4c3b-a04a-d2b886249080 req-bca4c9a4-3d8f-4853-bce2-f38628b39633 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:49.429476 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-ca7db430-9bcf-4c3b-a04a-d2b886249080 req-bca4c9a4-3d8f-4853-bce2-f38628b39633 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:49.429905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-ca7db430-9bcf-4c3b-a04a-d2b886249080 req-bca4c9a4-3d8f-4853-bce2-f38628b39633 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:49.441036 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-ca7db430-9bcf-4c3b-a04a-d2b886249080 req-bca4c9a4-3d8f-4853-bce2-f38628b39633 service nova] Creating event network-vif-plugged:846e0443-12a3-4f37-a28b-a559f43fd6b4 for instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d on hv-cinder-80152 Oct 14 03:10:49.446527 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-ca7db430-9bcf-4c3b-a04a-d2b886249080 req-bca4c9a4-3d8f-4853-bce2-f38628b39633 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032535 Oct 14 03:10:49.447440 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 234/463] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:49.506713 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-78153aaf-d9e5-460e-927d-fc565b3b6e22 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:49.507326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-78153aaf-d9e5-460e-927d-fc565b3b6e22 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:49.513668 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-78153aaf-d9e5-460e-927d-fc565b3b6e22 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:49.514137 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-78153aaf-d9e5-460e-927d-fc565b3b6e22 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:49.514632 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-78153aaf-d9e5-460e-927d-fc565b3b6e22 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:49.515321 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-78153aaf-d9e5-460e-927d-fc565b3b6e22 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:49.515767 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-78153aaf-d9e5-460e-927d-fc565b3b6e22 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:49.516187 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-78153aaf-d9e5-460e-927d-fc565b3b6e22 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:49.680454 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-78153aaf-d9e5-460e-927d-fc565b3b6e22 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:49.688059 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-78153aaf-d9e5-460e-927d-fc565b3b6e22 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1357 microversion: 2.1 time: 0.185742 Oct 14 03:10:49.689036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 230/464] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:49 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:49.795803 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0708aeab-ff33-4d4e-8e44-aa7a858a83e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:49.796535 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0708aeab-ff33-4d4e-8e44-aa7a858a83e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:49.803217 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0708aeab-ff33-4d4e-8e44-aa7a858a83e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:49.818104 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0708aeab-ff33-4d4e-8e44-aa7a858a83e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:49.818104 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0708aeab-ff33-4d4e-8e44-aa7a858a83e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:49.818104 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0708aeab-ff33-4d4e-8e44-aa7a858a83e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:49.818104 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0708aeab-ff33-4d4e-8e44-aa7a858a83e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:49.818450 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0708aeab-ff33-4d4e-8e44-aa7a858a83e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:49.939059 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0708aeab-ff33-4d4e-8e44-aa7a858a83e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:49.948629 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0708aeab-ff33-4d4e-8e44-aa7a858a83e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:49.950103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0708aeab-ff33-4d4e-8e44-aa7a858a83e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:49.951520 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0708aeab-ff33-4d4e-8e44-aa7a858a83e9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.161132 Oct 14 03:10:49.952075 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 235/465] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:49 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:50.065349 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-5875d74b-d7cf-4ac4-9f71-6823358daae2 req-74ed78bc-7b80-40f5-936a-29370c775945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f165841c-8922-4baa-909d-daf6b2e6b924", "name": "network-vif-deleted", "tag": "68b3e89f-dea9-471a-bb1c-93c3c17cade3"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:50.074877 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-5875d74b-d7cf-4ac4-9f71-6823358daae2 req-74ed78bc-7b80-40f5-936a-29370c775945 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.075659 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-5875d74b-d7cf-4ac4-9f71-6823358daae2 req-74ed78bc-7b80-40f5-936a-29370c775945 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.076097 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-5875d74b-d7cf-4ac4-9f71-6823358daae2 req-74ed78bc-7b80-40f5-936a-29370c775945 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.087633 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f02033bc-3026-4f19-ba66-1560ac0b2fec tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:50.088341 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f02033bc-3026-4f19-ba66-1560ac0b2fec tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:50.090428 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:50.090547 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-5875d74b-d7cf-4ac4-9f71-6823358daae2 req-74ed78bc-7b80-40f5-936a-29370c775945 service nova] Creating event network-vif-deleted:68b3e89f-dea9-471a-bb1c-93c3c17cade3 for instance f165841c-8922-4baa-909d-daf6b2e6b924 on hv-cinder-80152 Oct 14 03:10:50.095536 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f02033bc-3026-4f19-ba66-1560ac0b2fec tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.096027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f02033bc-3026-4f19-ba66-1560ac0b2fec tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.096708 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f02033bc-3026-4f19-ba66-1560ac0b2fec tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.098238 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f02033bc-3026-4f19-ba66-1560ac0b2fec tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.099041 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f02033bc-3026-4f19-ba66-1560ac0b2fec tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.099478 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f02033bc-3026-4f19-ba66-1560ac0b2fec tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.105364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-5875d74b-d7cf-4ac4-9f71-6823358daae2 req-74ed78bc-7b80-40f5-936a-29370c775945 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044293 Oct 14 03:10:50.106186 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 231/466] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:50.119419 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-fe1c10c9-1162-4cf2-8de7-f0bda240e6d4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:50.121383 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-fe1c10c9-1162-4cf2-8de7-f0bda240e6d4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:50.129519 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe1c10c9-1162-4cf2-8de7-f0bda240e6d4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.130246 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe1c10c9-1162-4cf2-8de7-f0bda240e6d4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.131067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe1c10c9-1162-4cf2-8de7-f0bda240e6d4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.131929 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe1c10c9-1162-4cf2-8de7-f0bda240e6d4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.132626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe1c10c9-1162-4cf2-8de7-f0bda240e6d4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.133209 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fe1c10c9-1162-4cf2-8de7-f0bda240e6d4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.207511 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-fe1c10c9-1162-4cf2-8de7-f0bda240e6d4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:50.216461 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-fe1c10c9-1162-4cf2-8de7-f0bda240e6d4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1613 microversion: 2.1 time: 0.101916 Oct 14 03:10:50.217233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 232/467] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:50 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1613 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:50.266256 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-acfed0f7-89bf-4098-977d-037ecb122c79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:50.266874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-acfed0f7-89bf-4098-977d-037ecb122c79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:50.277026 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f02033bc-3026-4f19-ba66-1560ac0b2fec tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:50.277299 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-acfed0f7-89bf-4098-977d-037ecb122c79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.278049 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-acfed0f7-89bf-4098-977d-037ecb122c79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.278489 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-acfed0f7-89bf-4098-977d-037ecb122c79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.279190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-acfed0f7-89bf-4098-977d-037ecb122c79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.279643 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-acfed0f7-89bf-4098-977d-037ecb122c79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.280609 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-acfed0f7-89bf-4098-977d-037ecb122c79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.287556 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f02033bc-3026-4f19-ba66-1560ac0b2fec tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.204979 Oct 14 03:10:50.288607 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 236/468] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:50 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:50.420022 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-acfed0f7-89bf-4098-977d-037ecb122c79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:50.428701 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-acfed0f7-89bf-4098-977d-037ecb122c79 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1677 microversion: 2.1 time: 0.166164 Oct 14 03:10:50.429236 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 233/469] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:50 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:50.713540 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-21f55f43-0491-45cd-88df-d215158d0467 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:50.714874 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-21f55f43-0491-45cd-88df-d215158d0467 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:50.724697 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-21f55f43-0491-45cd-88df-d215158d0467 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.725725 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-21f55f43-0491-45cd-88df-d215158d0467 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.726696 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-21f55f43-0491-45cd-88df-d215158d0467 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.727718 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-21f55f43-0491-45cd-88df-d215158d0467 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.728371 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-21f55f43-0491-45cd-88df-d215158d0467 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.729037 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-21f55f43-0491-45cd-88df-d215158d0467 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.891177 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-21f55f43-0491-45cd-88df-d215158d0467 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:50.901938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-21f55f43-0491-45cd-88df-d215158d0467 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1546 microversion: 2.1 time: 0.192347 Oct 14 03:10:50.902573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 237/470] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:50 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1546 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:50.924825 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6de261c4-b271-4a43-a786-d7110ea97c48 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:50.925937 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6de261c4-b271-4a43-a786-d7110ea97c48 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:50.932742 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6de261c4-b271-4a43-a786-d7110ea97c48 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.933194 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6de261c4-b271-4a43-a786-d7110ea97c48 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.933636 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6de261c4-b271-4a43-a786-d7110ea97c48 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.934346 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6de261c4-b271-4a43-a786-d7110ea97c48 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.934809 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6de261c4-b271-4a43-a786-d7110ea97c48 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.935277 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6de261c4-b271-4a43-a786-d7110ea97c48 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.977179 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-556e3f66-4f35-4e13-85b4-336a7d0f9423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:50.978059 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-556e3f66-4f35-4e13-85b4-336a7d0f9423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:50.986110 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-556e3f66-4f35-4e13-85b4-336a7d0f9423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.986898 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-556e3f66-4f35-4e13-85b4-336a7d0f9423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.987502 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-556e3f66-4f35-4e13-85b4-336a7d0f9423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.988750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-556e3f66-4f35-4e13-85b4-336a7d0f9423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.989479 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-556e3f66-4f35-4e13-85b4-336a7d0f9423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.990063 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-556e3f66-4f35-4e13-85b4-336a7d0f9423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.148936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6de261c4-b271-4a43-a786-d7110ea97c48 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:51.158589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6de261c4-b271-4a43-a786-d7110ea97c48 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1546 microversion: 2.1 time: 0.238106 Oct 14 03:10:51.159779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 234/471] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:50 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1546 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:51.197069 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-556e3f66-4f35-4e13-85b4-336a7d0f9423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:51.207027 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e0710555-4b0f-4f7c-8135-0440072e1f3f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:51.218331 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-556e3f66-4f35-4e13-85b4-336a7d0f9423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:51.219345 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-556e3f66-4f35-4e13-85b4-336a7d0f9423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:51.220721 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-556e3f66-4f35-4e13-85b4-336a7d0f9423 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.247493 Oct 14 03:10:51.222377 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 238/472] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:50 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:51.223214 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e0710555-4b0f-4f7c-8135-0440072e1f3f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:51.224380 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e0710555-4b0f-4f7c-8135-0440072e1f3f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Searching by: {'deleted': False, 'project_id': '709ccf636093493093e88488ce49484f'} {{(pid=119302) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 14 03:10:51.231708 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0710555-4b0f-4f7c-8135-0440072e1f3f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.232561 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0710555-4b0f-4f7c-8135-0440072e1f3f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.233299 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0710555-4b0f-4f7c-8135-0440072e1f3f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.234426 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0710555-4b0f-4f7c-8135-0440072e1f3f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.235017 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0710555-4b0f-4f7c-8135-0440072e1f3f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.240999 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-eed17887-6d64-467f-b1df-9dafe03f333c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:51.241884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-eed17887-6d64-467f-b1df-9dafe03f333c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:51.248660 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e0710555-4b0f-4f7c-8135-0440072e1f3f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.251855 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eed17887-6d64-467f-b1df-9dafe03f333c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.260789 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eed17887-6d64-467f-b1df-9dafe03f333c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.261523 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eed17887-6d64-467f-b1df-9dafe03f333c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.263002 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eed17887-6d64-467f-b1df-9dafe03f333c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.263630 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eed17887-6d64-467f-b1df-9dafe03f333c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.264823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eed17887-6d64-467f-b1df-9dafe03f333c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.321278 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eed17887-6d64-467f-b1df-9dafe03f333c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.322081 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eed17887-6d64-467f-b1df-9dafe03f333c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.322671 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-eed17887-6d64-467f-b1df-9dafe03f333c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.323271 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-eed17887-6d64-467f-b1df-9dafe03f333c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lazy-loading 'fault' on Instance uuid f165841c-8922-4baa-909d-daf6b2e6b924 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:51.392481 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-eed17887-6d64-467f-b1df-9dafe03f333c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:51.401807 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-eed17887-6d64-467f-b1df-9dafe03f333c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1330 microversion: 2.1 time: 0.165209 Oct 14 03:10:51.402387 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 239/473] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:51 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1330 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:51.410701 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-366f6459-21c8-46f1-935f-bbb57dd0da07 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:51.411510 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-366f6459-21c8-46f1-935f-bbb57dd0da07 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:51.415103 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.multi_cell_list [None req-e0710555-4b0f-4f7c-8135-0440072e1f3f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 14 03:10:51.419145 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-366f6459-21c8-46f1-935f-bbb57dd0da07 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.419787 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-366f6459-21c8-46f1-935f-bbb57dd0da07 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.420401 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-366f6459-21c8-46f1-935f-bbb57dd0da07 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.421380 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-366f6459-21c8-46f1-935f-bbb57dd0da07 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.421981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-366f6459-21c8-46f1-935f-bbb57dd0da07 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.422553 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-366f6459-21c8-46f1-935f-bbb57dd0da07 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.549867 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e0710555-4b0f-4f7c-8135-0440072e1f3f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.367200 Oct 14 03:10:51.557749 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 235/474] 10.222.0.13 () {58 vars in 1125 bytes} [Fri Oct 14 03:10:51 2022] GET /compute/v2.1/servers => generated 341 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:51.557749 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c73674d8-c5e6-4434-857b-256eec10ab16 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:51.557749 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c73674d8-c5e6-4434-857b-256eec10ab16 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:51.565441 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c73674d8-c5e6-4434-857b-256eec10ab16 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.567860 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c73674d8-c5e6-4434-857b-256eec10ab16 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.567860 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c73674d8-c5e6-4434-857b-256eec10ab16 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.568046 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c73674d8-c5e6-4434-857b-256eec10ab16 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.568458 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c73674d8-c5e6-4434-857b-256eec10ab16 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.569096 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c73674d8-c5e6-4434-857b-256eec10ab16 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.637545 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-366f6459-21c8-46f1-935f-bbb57dd0da07 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:51.645621 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-366f6459-21c8-46f1-935f-bbb57dd0da07 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.238532 Oct 14 03:10:51.667588 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 240/475] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:51 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:51.677959 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-91a9b6a7-372f-429d-be6e-bb4870a523e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:51.678820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-91a9b6a7-372f-429d-be6e-bb4870a523e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:51.693120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-91a9b6a7-372f-429d-be6e-bb4870a523e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.693569 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-91a9b6a7-372f-429d-be6e-bb4870a523e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.694047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-91a9b6a7-372f-429d-be6e-bb4870a523e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.695182 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-91a9b6a7-372f-429d-be6e-bb4870a523e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.695720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-91a9b6a7-372f-429d-be6e-bb4870a523e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.698112 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-91a9b6a7-372f-429d-be6e-bb4870a523e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.792898 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c73674d8-c5e6-4434-857b-256eec10ab16 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:51.801394 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c73674d8-c5e6-4434-857b-256eec10ab16 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1677 microversion: 2.1 time: 0.247892 Oct 14 03:10:51.802058 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 236/476] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:51 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1677 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:51.806632 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-d8aecf8e-f5d0-48e8-86b5-85601eb568ce req-c1aae8c6-1c11-4338-b434-b8d801eaf452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dba68e3-51ca-4ce2-9165-0d04c196138a", "name": "network-vif-plugged", "status": "completed", "tag": "5e3c73a5-6040-4749-994f-19fa7172d3e2"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:51.816633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-d8aecf8e-f5d0-48e8-86b5-85601eb568ce req-c1aae8c6-1c11-4338-b434-b8d801eaf452 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.817115 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-d8aecf8e-f5d0-48e8-86b5-85601eb568ce req-c1aae8c6-1c11-4338-b434-b8d801eaf452 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.817574 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-d8aecf8e-f5d0-48e8-86b5-85601eb568ce req-c1aae8c6-1c11-4338-b434-b8d801eaf452 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.831301 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-d8aecf8e-f5d0-48e8-86b5-85601eb568ce req-c1aae8c6-1c11-4338-b434-b8d801eaf452 service nova] Creating event network-vif-plugged:5e3c73a5-6040-4749-994f-19fa7172d3e2 for instance 0dba68e3-51ca-4ce2-9165-0d04c196138a on hv-cinder-80152 Oct 14 03:10:51.836966 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-d8aecf8e-f5d0-48e8-86b5-85601eb568ce req-c1aae8c6-1c11-4338-b434-b8d801eaf452 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033642 Oct 14 03:10:51.837573 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 237/477] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:51.866797 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-91a9b6a7-372f-429d-be6e-bb4870a523e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:51.874657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-91a9b6a7-372f-429d-be6e-bb4870a523e9 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1546 microversion: 2.1 time: 0.205257 Oct 14 03:10:51.875312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 241/478] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:51 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1546 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:52.253191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ab275250-ebef-46b0-93a7-fd1018d0ceeb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:52.254264 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ab275250-ebef-46b0-93a7-fd1018d0ceeb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:52.262113 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ab275250-ebef-46b0-93a7-fd1018d0ceeb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:52.262621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ab275250-ebef-46b0-93a7-fd1018d0ceeb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:52.264082 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ab275250-ebef-46b0-93a7-fd1018d0ceeb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:52.264971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ab275250-ebef-46b0-93a7-fd1018d0ceeb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:52.265534 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ab275250-ebef-46b0-93a7-fd1018d0ceeb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:52.266065 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ab275250-ebef-46b0-93a7-fd1018d0ceeb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:52.408738 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ab275250-ebef-46b0-93a7-fd1018d0ceeb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:52.417717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ab275250-ebef-46b0-93a7-fd1018d0ceeb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:52.422193 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ab275250-ebef-46b0-93a7-fd1018d0ceeb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:52.422193 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ab275250-ebef-46b0-93a7-fd1018d0ceeb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.171474 Oct 14 03:10:52.422193 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 238/479] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:52 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:52.429156 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-dc358ddf-d573-4e7d-a7f2-7f8fb5b131e5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:52.429774 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-dc358ddf-d573-4e7d-a7f2-7f8fb5b131e5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:52.435842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dc358ddf-d573-4e7d-a7f2-7f8fb5b131e5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:52.436327 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dc358ddf-d573-4e7d-a7f2-7f8fb5b131e5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:52.436823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dc358ddf-d573-4e7d-a7f2-7f8fb5b131e5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:52.437517 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dc358ddf-d573-4e7d-a7f2-7f8fb5b131e5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:52.437975 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dc358ddf-d573-4e7d-a7f2-7f8fb5b131e5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:52.438401 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dc358ddf-d573-4e7d-a7f2-7f8fb5b131e5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:52.491024 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dc358ddf-d573-4e7d-a7f2-7f8fb5b131e5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:52.491597 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dc358ddf-d573-4e7d-a7f2-7f8fb5b131e5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:52.492123 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dc358ddf-d573-4e7d-a7f2-7f8fb5b131e5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:52.492830 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-dc358ddf-d573-4e7d-a7f2-7f8fb5b131e5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lazy-loading 'fault' on Instance uuid f165841c-8922-4baa-909d-daf6b2e6b924 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:52.544184 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-dc358ddf-d573-4e7d-a7f2-7f8fb5b131e5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:52.552237 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-dc358ddf-d573-4e7d-a7f2-7f8fb5b131e5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1330 microversion: 2.1 time: 0.126886 Oct 14 03:10:52.552914 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 242/480] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:52 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1330 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:52.673473 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-1344a2ee-5426-46af-aae6-218e43060295 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:52.678665 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-1344a2ee-5426-46af-aae6-218e43060295 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:52.680836 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1344a2ee-5426-46af-aae6-218e43060295 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:52.681324 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1344a2ee-5426-46af-aae6-218e43060295 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:52.681756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1344a2ee-5426-46af-aae6-218e43060295 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:52.682453 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1344a2ee-5426-46af-aae6-218e43060295 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:52.682904 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1344a2ee-5426-46af-aae6-218e43060295 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:52.683327 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1344a2ee-5426-46af-aae6-218e43060295 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:52.824746 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1344a2ee-5426-46af-aae6-218e43060295 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:52.824927 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-05d41f66-1f9b-4bec-b94c-78b8e5bbd570 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:52.825783 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-05d41f66-1f9b-4bec-b94c-78b8e5bbd570 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:52.832095 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05d41f66-1f9b-4bec-b94c-78b8e5bbd570 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:52.832885 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05d41f66-1f9b-4bec-b94c-78b8e5bbd570 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:52.833650 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05d41f66-1f9b-4bec-b94c-78b8e5bbd570 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:52.834337 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05d41f66-1f9b-4bec-b94c-78b8e5bbd570 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:52.834791 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05d41f66-1f9b-4bec-b94c-78b8e5bbd570 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:52.835170 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-1344a2ee-5426-46af-aae6-218e43060295 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.165924 Oct 14 03:10:52.835312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05d41f66-1f9b-4bec-b94c-78b8e5bbd570 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:52.836910 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 239/481] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:52 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:53.178518 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-05d41f66-1f9b-4bec-b94c-78b8e5bbd570 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:53.186248 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-05d41f66-1f9b-4bec-b94c-78b8e5bbd570 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1677 microversion: 2.1 time: 0.365257 Oct 14 03:10:53.186814 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 243/482] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:52 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1677 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:53.446183 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b07e3c89-7440-4dd2-9067-8475b465e66c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:53.446801 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b07e3c89-7440-4dd2-9067-8475b465e66c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:53.453982 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b07e3c89-7440-4dd2-9067-8475b465e66c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.454507 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b07e3c89-7440-4dd2-9067-8475b465e66c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.454945 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b07e3c89-7440-4dd2-9067-8475b465e66c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:53.455643 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b07e3c89-7440-4dd2-9067-8475b465e66c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.456141 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b07e3c89-7440-4dd2-9067-8475b465e66c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.456612 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b07e3c89-7440-4dd2-9067-8475b465e66c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:53.575906 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fab96df0-0e14-4e00-825f-31a97e843dd7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:53.576546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fab96df0-0e14-4e00-825f-31a97e843dd7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:53.582906 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fab96df0-0e14-4e00-825f-31a97e843dd7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.583499 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fab96df0-0e14-4e00-825f-31a97e843dd7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.583848 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fab96df0-0e14-4e00-825f-31a97e843dd7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:53.584897 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fab96df0-0e14-4e00-825f-31a97e843dd7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.585048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fab96df0-0e14-4e00-825f-31a97e843dd7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.585640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fab96df0-0e14-4e00-825f-31a97e843dd7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:53.594837 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b07e3c89-7440-4dd2-9067-8475b465e66c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:53.613500 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b07e3c89-7440-4dd2-9067-8475b465e66c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:53.616328 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b07e3c89-7440-4dd2-9067-8475b465e66c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:53.617393 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b07e3c89-7440-4dd2-9067-8475b465e66c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.175260 Oct 14 03:10:53.618437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 240/483] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:53 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:53.621572 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fab96df0-0e14-4e00-825f-31a97e843dd7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.622458 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fab96df0-0e14-4e00-825f-31a97e843dd7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.622986 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fab96df0-0e14-4e00-825f-31a97e843dd7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:53.628585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-fab96df0-0e14-4e00-825f-31a97e843dd7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lazy-loading 'fault' on Instance uuid f165841c-8922-4baa-909d-daf6b2e6b924 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:53.672240 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fab96df0-0e14-4e00-825f-31a97e843dd7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:53.682008 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fab96df0-0e14-4e00-825f-31a97e843dd7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1330 microversion: 2.1 time: 0.110671 Oct 14 03:10:53.682577 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 244/484] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:53 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:53.815699 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-44475e44-330a-4919-a3d6-b83a530471b5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1712f1e-c3cf-4b42-ae79-3a8abf96e667"}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:53.818799 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-44475e44-330a-4919-a3d6-b83a530471b5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:53.824762 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-44475e44-330a-4919-a3d6-b83a530471b5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.825499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-44475e44-330a-4919-a3d6-b83a530471b5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.825932 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-44475e44-330a-4919-a3d6-b83a530471b5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:53.826618 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-44475e44-330a-4919-a3d6-b83a530471b5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.827068 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-44475e44-330a-4919-a3d6-b83a530471b5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.827483 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-44475e44-330a-4919-a3d6-b83a530471b5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:53.858420 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9d006618-7482-4667-a524-503388f71025 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:53.859109 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-9d006618-7482-4667-a524-503388f71025 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:53.866081 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d006618-7482-4667-a524-503388f71025 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.866866 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d006618-7482-4667-a524-503388f71025 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.867471 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d006618-7482-4667-a524-503388f71025 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:53.868550 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d006618-7482-4667-a524-503388f71025 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.869106 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d006618-7482-4667-a524-503388f71025 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.869599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d006618-7482-4667-a524-503388f71025 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:54.004617 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-9d006618-7482-4667-a524-503388f71025 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:54.008004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:54.012475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9d006618-7482-4667-a524-503388f71025 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1319 microversion: 2.1 time: 0.158096 Oct 14 03:10:54.013050 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 245/485] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:53 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:54.210458 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-30336655-b3b5-49aa-b6b6-75ea98ce52ed tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:54.211090 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-30336655-b3b5-49aa-b6b6-75ea98ce52ed tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:54.217988 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-30336655-b3b5-49aa-b6b6-75ea98ce52ed tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:54.218483 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-30336655-b3b5-49aa-b6b6-75ea98ce52ed tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:54.218925 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-30336655-b3b5-49aa-b6b6-75ea98ce52ed tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:54.219755 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-30336655-b3b5-49aa-b6b6-75ea98ce52ed tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:54.220217 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-30336655-b3b5-49aa-b6b6-75ea98ce52ed tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:54.220670 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-30336655-b3b5-49aa-b6b6-75ea98ce52ed tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:54.352424 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-30336655-b3b5-49aa-b6b6-75ea98ce52ed tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:54.360178 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-30336655-b3b5-49aa-b6b6-75ea98ce52ed tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1677 microversion: 2.1 time: 0.154521 Oct 14 03:10:54.360804 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 246/486] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:54 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:54.643146 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d8885c7a-c5aa-4a11-81f5-777a3c85ee0c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:54.643763 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d8885c7a-c5aa-4a11-81f5-777a3c85ee0c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:54.650831 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d8885c7a-c5aa-4a11-81f5-777a3c85ee0c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:54.651322 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d8885c7a-c5aa-4a11-81f5-777a3c85ee0c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:54.651762 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d8885c7a-c5aa-4a11-81f5-777a3c85ee0c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:54.652493 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d8885c7a-c5aa-4a11-81f5-777a3c85ee0c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:54.652953 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d8885c7a-c5aa-4a11-81f5-777a3c85ee0c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:54.653388 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d8885c7a-c5aa-4a11-81f5-777a3c85ee0c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:54.789443 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d8885c7a-c5aa-4a11-81f5-777a3c85ee0c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:54.798458 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d8885c7a-c5aa-4a11-81f5-777a3c85ee0c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:54.799943 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d8885c7a-c5aa-4a11-81f5-777a3c85ee0c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:54.801187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d8885c7a-c5aa-4a11-81f5-777a3c85ee0c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1807 microversion: 2.20 time: 0.162023 Oct 14 03:10:54.801775 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 247/487] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:54 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:54.806385 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5848d780-97b5-47be-a029-962763302f5e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:54.807445 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5848d780-97b5-47be-a029-962763302f5e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:54.812905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5848d780-97b5-47be-a029-962763302f5e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:54.813392 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5848d780-97b5-47be-a029-962763302f5e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:54.813835 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5848d780-97b5-47be-a029-962763302f5e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:54.814534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5848d780-97b5-47be-a029-962763302f5e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:54.814985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5848d780-97b5-47be-a029-962763302f5e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:54.815412 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5848d780-97b5-47be-a029-962763302f5e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:54.856215 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5848d780-97b5-47be-a029-962763302f5e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:54.856739 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5848d780-97b5-47be-a029-962763302f5e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:54.857180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5848d780-97b5-47be-a029-962763302f5e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:54.857636 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-5848d780-97b5-47be-a029-962763302f5e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lazy-loading 'fault' on Instance uuid f165841c-8922-4baa-909d-daf6b2e6b924 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:54.900002 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5848d780-97b5-47be-a029-962763302f5e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:54.908280 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5848d780-97b5-47be-a029-962763302f5e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 200 len: 1330 microversion: 2.1 time: 0.105481 Oct 14 03:10:54.908865 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 248/488] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:54 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:55.035055 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-dde15dc2-4ef2-42a6-bb29-4231fcbf597a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:55.035661 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-dde15dc2-4ef2-42a6-bb29-4231fcbf597a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:55.041760 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dde15dc2-4ef2-42a6-bb29-4231fcbf597a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:55.042259 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dde15dc2-4ef2-42a6-bb29-4231fcbf597a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:55.042678 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dde15dc2-4ef2-42a6-bb29-4231fcbf597a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:55.043359 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dde15dc2-4ef2-42a6-bb29-4231fcbf597a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:55.043810 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dde15dc2-4ef2-42a6-bb29-4231fcbf597a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:55.044230 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dde15dc2-4ef2-42a6-bb29-4231fcbf597a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:55.172323 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-dde15dc2-4ef2-42a6-bb29-4231fcbf597a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:55.180751 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-dde15dc2-4ef2-42a6-bb29-4231fcbf597a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1508 microversion: 2.1 time: 0.149605 Oct 14 03:10:55.181316 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 249/489] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:55 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:55.296776 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-44475e44-330a-4919-a3d6-b83a530471b5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "POST /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.484812 Oct 14 03:10:55.301143 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 241/490] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Oct 14 03:10:53 2022] POST /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments => generated 194 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:55.382851 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8a6bdc5e-dd1d-4fca-b257-54b86182756e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:55.383462 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8a6bdc5e-dd1d-4fca-b257-54b86182756e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:55.389683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8a6bdc5e-dd1d-4fca-b257-54b86182756e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:55.390162 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8a6bdc5e-dd1d-4fca-b257-54b86182756e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:55.390601 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8a6bdc5e-dd1d-4fca-b257-54b86182756e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:55.391300 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8a6bdc5e-dd1d-4fca-b257-54b86182756e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:55.391750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8a6bdc5e-dd1d-4fca-b257-54b86182756e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:55.392174 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8a6bdc5e-dd1d-4fca-b257-54b86182756e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:55.538582 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8a6bdc5e-dd1d-4fca-b257-54b86182756e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:55.549953 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8a6bdc5e-dd1d-4fca-b257-54b86182756e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1677 microversion: 2.1 time: 0.170816 Oct 14 03:10:55.551568 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 250/491] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:55 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:55.833067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-334a87f1-ee23-4b1f-be11-06174832eddc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:55.833849 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-334a87f1-ee23-4b1f-be11-06174832eddc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:55.839841 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-334a87f1-ee23-4b1f-be11-06174832eddc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:55.844780 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-334a87f1-ee23-4b1f-be11-06174832eddc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:55.844780 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-334a87f1-ee23-4b1f-be11-06174832eddc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:55.844780 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-334a87f1-ee23-4b1f-be11-06174832eddc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:55.844780 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-334a87f1-ee23-4b1f-be11-06174832eddc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:55.845159 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-334a87f1-ee23-4b1f-be11-06174832eddc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:55.930096 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ba42d699-e27a-4760-a8b9-25ac66359955 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:55.930716 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ba42d699-e27a-4760-a8b9-25ac66359955 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:55.937445 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ba42d699-e27a-4760-a8b9-25ac66359955 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:55.937934 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ba42d699-e27a-4760-a8b9-25ac66359955 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:55.938366 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ba42d699-e27a-4760-a8b9-25ac66359955 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:55.939067 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ba42d699-e27a-4760-a8b9-25ac66359955 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:55.939516 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ba42d699-e27a-4760-a8b9-25ac66359955 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:55.939936 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ba42d699-e27a-4760-a8b9-25ac66359955 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:55.954202 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-ba42d699-e27a-4760-a8b9-25ac66359955 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] HTTP exception thrown: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ba42d699-e27a-4760-a8b9-25ac66359955 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Request method failure captured: Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 HTTP/1.1 Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNKG-ky05sope_YdGjGweAljK5FUxzsY0TE3JqS7jM4jPzALKbCEnItlHGzo5Xg-IOfB8MCgv3mdaVNqvdBnmYZMENHyFWRo7_9tNs76BHsJnl6Osbo5VySDApF7HiliGWSEh0OSOTvdEIMsVWp5oVBM2GccEYCsyuR5X3gKYrX8g9g Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:10:55.955854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:10:55.958027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:10:55.958027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:10:55.958027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:10:55.958027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:10:55.958027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:10:55.958027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:10:55.958027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:10:55.958027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 4553b7573ca34af6a9fdb94f80717f24 Oct 14 03:10:55.958027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:10:55.958027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:10:55.958027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:10:55.958027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': 'f165841c-8922-4baa-909d-daf6b2e6b924'} Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:10:55.958992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:10:55.966394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:10:55.967812 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ba42d699-e27a-4760-a8b9-25ac66359955 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Returning 404 to user: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:10:55.967812 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ba42d699-e27a-4760-a8b9-25ac66359955 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 404 len: 111 microversion: 2.1 time: 0.032273 Oct 14 03:10:55.967812 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 251/492] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:55 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:10:55.974358 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b3f26fef-c50d-4e68-9ff4-261c7f921d27 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '.version_select at 0x7fdcc8f0caf0>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:55.999972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-334a87f1-ee23-4b1f-be11-06174832eddc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:56.009246 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-334a87f1-ee23-4b1f-be11-06174832eddc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:56.010783 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-334a87f1-ee23-4b1f-be11-06174832eddc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:56.012022 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-334a87f1-ee23-4b1f-be11-06174832eddc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1794 microversion: 2.20 time: 0.184313 Oct 14 03:10:56.012612 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 242/493] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:55 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1794 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:56.048977 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b3f26fef-c50d-4e68-9ff4-261c7f921d27 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-784416825" status: 202 len: 0 microversion: 2.1 time: 0.079168 Oct 14 03:10:56.049993 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 252/494] 10.222.0.13 () {58 vars in 1218 bytes} [Fri Oct 14 03:10:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-784416825 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:10:56.576432 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-af663235-91c7-46e1-bed6-161b2b29d906 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:56.577043 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-af663235-91c7-46e1-bed6-161b2b29d906 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:56.583367 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af663235-91c7-46e1-bed6-161b2b29d906 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:56.583849 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af663235-91c7-46e1-bed6-161b2b29d906 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:56.584284 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af663235-91c7-46e1-bed6-161b2b29d906 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:56.585021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af663235-91c7-46e1-bed6-161b2b29d906 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:56.585480 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af663235-91c7-46e1-bed6-161b2b29d906 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:56.585899 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-af663235-91c7-46e1-bed6-161b2b29d906 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:56.726129 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-af663235-91c7-46e1-bed6-161b2b29d906 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:56.734986 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-af663235-91c7-46e1-bed6-161b2b29d906 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1677 microversion: 2.1 time: 0.162463 Oct 14 03:10:56.742223 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 243/495] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:56 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:56.857187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-634114d6-2d11-4963-9e82-1b298eb6a03e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:56.858882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-634114d6-2d11-4963-9e82-1b298eb6a03e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:56.865533 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-634114d6-2d11-4963-9e82-1b298eb6a03e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:56.866108 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-634114d6-2d11-4963-9e82-1b298eb6a03e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:56.866768 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-634114d6-2d11-4963-9e82-1b298eb6a03e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:56.867645 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-634114d6-2d11-4963-9e82-1b298eb6a03e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:56.868105 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-634114d6-2d11-4963-9e82-1b298eb6a03e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:56.868653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-634114d6-2d11-4963-9e82-1b298eb6a03e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:56.995513 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-634114d6-2d11-4963-9e82-1b298eb6a03e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lazy-loading 'services' on Instance uuid 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:57.246532 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-634114d6-2d11-4963-9e82-1b298eb6a03e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d/os-volume_attachments/4d9ea303-3b32-4e79-9633-1de971d83f37" status: 202 len: 0 microversion: 2.1 time: 0.395774 Oct 14 03:10:57.247127 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 253/496] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Oct 14 03:10:56 2022] DELETE /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d/os-volume_attachments/4d9ea303-3b32-4e79-9633-1de971d83f37 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:10:57.255566 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ec6e9679-b5d6-4645-add6-ac4b94d98f37 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:57.257923 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ec6e9679-b5d6-4645-add6-ac4b94d98f37 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:57.263929 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ec6e9679-b5d6-4645-add6-ac4b94d98f37 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:57.264442 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ec6e9679-b5d6-4645-add6-ac4b94d98f37 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:57.264884 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ec6e9679-b5d6-4645-add6-ac4b94d98f37 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.265573 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ec6e9679-b5d6-4645-add6-ac4b94d98f37 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:57.266032 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ec6e9679-b5d6-4645-add6-ac4b94d98f37 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:57.266466 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ec6e9679-b5d6-4645-add6-ac4b94d98f37 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.280781 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:57.296851 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ec6e9679-b5d6-4645-add6-ac4b94d98f37 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045152 Oct 14 03:10:57.297420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 244/497] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:10:57 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:57.759912 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f8b045e6-20ce-4eaf-932c-8cb4c423d7d2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:57.760647 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f8b045e6-20ce-4eaf-932c-8cb4c423d7d2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:57.766881 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f8b045e6-20ce-4eaf-932c-8cb4c423d7d2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:57.767361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f8b045e6-20ce-4eaf-932c-8cb4c423d7d2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:57.767800 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f8b045e6-20ce-4eaf-932c-8cb4c423d7d2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.768529 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f8b045e6-20ce-4eaf-932c-8cb4c423d7d2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:57.768980 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f8b045e6-20ce-4eaf-932c-8cb4c423d7d2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:57.770029 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f8b045e6-20ce-4eaf-932c-8cb4c423d7d2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.904101 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f8b045e6-20ce-4eaf-932c-8cb4c423d7d2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:57.912087 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f8b045e6-20ce-4eaf-932c-8cb4c423d7d2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1677 microversion: 2.1 time: 0.156444 Oct 14 03:10:57.912690 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 254/498] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:57 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:58.310766 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-90a1a526-4805-4592-a330-d489279c5ce3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:58.312876 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-90a1a526-4805-4592-a330-d489279c5ce3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:58.319704 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-90a1a526-4805-4592-a330-d489279c5ce3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.320189 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-90a1a526-4805-4592-a330-d489279c5ce3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.320659 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-90a1a526-4805-4592-a330-d489279c5ce3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.321352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-90a1a526-4805-4592-a330-d489279c5ce3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.321805 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-90a1a526-4805-4592-a330-d489279c5ce3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.322234 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-90a1a526-4805-4592-a330-d489279c5ce3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.353940 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-90a1a526-4805-4592-a330-d489279c5ce3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048138 Oct 14 03:10:58.354510 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 245/499] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:10:58 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:58.670038 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-6b111224-393c-473d-86c6-c02e369631c8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:58.670759 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-6b111224-393c-473d-86c6-c02e369631c8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:58.677641 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6b111224-393c-473d-86c6-c02e369631c8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.678336 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6b111224-393c-473d-86c6-c02e369631c8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.678773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6b111224-393c-473d-86c6-c02e369631c8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.679479 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6b111224-393c-473d-86c6-c02e369631c8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.679932 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6b111224-393c-473d-86c6-c02e369631c8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.680356 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6b111224-393c-473d-86c6-c02e369631c8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.811390 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-6b111224-393c-473d-86c6-c02e369631c8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:58.821188 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-6b111224-393c-473d-86c6-c02e369631c8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1592 microversion: 2.1 time: 0.155080 Oct 14 03:10:58.821749 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 255/500] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:58 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1592 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:58.937462 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-cbdba032-3fa8-4e9e-b86a-7281a27ef24e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:58.938075 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-cbdba032-3fa8-4e9e-b86a-7281a27ef24e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:58.945393 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cbdba032-3fa8-4e9e-b86a-7281a27ef24e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.946463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cbdba032-3fa8-4e9e-b86a-7281a27ef24e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.946890 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cbdba032-3fa8-4e9e-b86a-7281a27ef24e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.947780 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cbdba032-3fa8-4e9e-b86a-7281a27ef24e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.948744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cbdba032-3fa8-4e9e-b86a-7281a27ef24e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.949232 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cbdba032-3fa8-4e9e-b86a-7281a27ef24e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:59.084157 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-cbdba032-3fa8-4e9e-b86a-7281a27ef24e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:59.092722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-cbdba032-3fa8-4e9e-b86a-7281a27ef24e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1677 microversion: 2.1 time: 0.160474 Oct 14 03:10:59.096459 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 246/501] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:58 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:59.366661 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a92b9168-8a12-4010-9bcd-4f51b0f649dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:59.369420 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a92b9168-8a12-4010-9bcd-4f51b0f649dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:59.375444 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a92b9168-8a12-4010-9bcd-4f51b0f649dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:59.376100 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a92b9168-8a12-4010-9bcd-4f51b0f649dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:59.376577 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a92b9168-8a12-4010-9bcd-4f51b0f649dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:59.377263 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a92b9168-8a12-4010-9bcd-4f51b0f649dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:59.377889 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a92b9168-8a12-4010-9bcd-4f51b0f649dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:59.378308 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a92b9168-8a12-4010-9bcd-4f51b0f649dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:59.407173 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a92b9168-8a12-4010-9bcd-4f51b0f649dd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044632 Oct 14 03:10:59.407847 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 256/502] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:10:59 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:10:59.471676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f46fd601-8a16-4772-9ec7-0b359a3dd3ab tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:59.472185 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f46fd601-8a16-4772-9ec7-0b359a3dd3ab tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:59.480456 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f46fd601-8a16-4772-9ec7-0b359a3dd3ab tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:59.481560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f46fd601-8a16-4772-9ec7-0b359a3dd3ab tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:59.482256 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f46fd601-8a16-4772-9ec7-0b359a3dd3ab tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:59.483535 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f46fd601-8a16-4772-9ec7-0b359a3dd3ab tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:59.484375 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f46fd601-8a16-4772-9ec7-0b359a3dd3ab tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:59.485048 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f46fd601-8a16-4772-9ec7-0b359a3dd3ab tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:59.511298 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f46fd601-8a16-4772-9ec7-0b359a3dd3ab tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Going to try to terminate instance {{(pid=119302) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:10:59.922799 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f46fd601-8a16-4772-9ec7-0b359a3dd3ab tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 204 len: 0 microversion: 2.1 time: 0.454752 Oct 14 03:10:59.923391 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 247/503] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:10:59 2022] DELETE /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:10:59.931924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d084ecb5-29ed-41cd-a632-399aba92bc0d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:59.932671 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d084ecb5-29ed-41cd-a632-399aba92bc0d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:59.939068 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d084ecb5-29ed-41cd-a632-399aba92bc0d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:59.939545 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d084ecb5-29ed-41cd-a632-399aba92bc0d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:59.939980 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d084ecb5-29ed-41cd-a632-399aba92bc0d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:59.940700 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d084ecb5-29ed-41cd-a632-399aba92bc0d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:59.941175 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d084ecb5-29ed-41cd-a632-399aba92bc0d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:59.941595 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d084ecb5-29ed-41cd-a632-399aba92bc0d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:00.085491 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d084ecb5-29ed-41cd-a632-399aba92bc0d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:00.093336 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d084ecb5-29ed-41cd-a632-399aba92bc0d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1683 microversion: 2.1 time: 0.165203 Oct 14 03:11:00.093903 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 257/504] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:59 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:00.119626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-186bf30f-367d-427d-b7a8-667d14a6fcc4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:00.120337 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-186bf30f-367d-427d-b7a8-667d14a6fcc4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:00.126350 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-186bf30f-367d-427d-b7a8-667d14a6fcc4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:00.126835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-186bf30f-367d-427d-b7a8-667d14a6fcc4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:00.127276 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-186bf30f-367d-427d-b7a8-667d14a6fcc4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:00.127971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-186bf30f-367d-427d-b7a8-667d14a6fcc4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:00.128445 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-186bf30f-367d-427d-b7a8-667d14a6fcc4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:00.128874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-186bf30f-367d-427d-b7a8-667d14a6fcc4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:00.264800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-186bf30f-367d-427d-b7a8-667d14a6fcc4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:00.272616 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-186bf30f-367d-427d-b7a8-667d14a6fcc4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1677 microversion: 2.1 time: 0.157781 Oct 14 03:11:00.273188 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 248/505] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:00 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:01.029360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-c1e401ba-03af-404b-a393-00c6d30b4e95 req-a46665e1-2d5d-46a8-8284-f73c7a8eb47b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c3606f-b3fb-4249-b5fd-a2de8f5debc2", "tag": "fcb4f2b3-a43c-4d79-98f7-46d493d8d296"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:01.041332 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-c1e401ba-03af-404b-a393-00c6d30b4e95 req-a46665e1-2d5d-46a8-8284-f73c7a8eb47b service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:01.042075 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-c1e401ba-03af-404b-a393-00c6d30b4e95 req-a46665e1-2d5d-46a8-8284-f73c7a8eb47b service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:01.043083 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-c1e401ba-03af-404b-a393-00c6d30b4e95 req-a46665e1-2d5d-46a8-8284-f73c7a8eb47b service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:01.056215 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-c1e401ba-03af-404b-a393-00c6d30b4e95 req-a46665e1-2d5d-46a8-8284-f73c7a8eb47b service nova] Creating event network-changed:fcb4f2b3-a43c-4d79-98f7-46d493d8d296 for instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 on hv-cinder-80152 Oct 14 03:11:01.065338 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-c1e401ba-03af-404b-a393-00c6d30b4e95 req-a46665e1-2d5d-46a8-8284-f73c7a8eb47b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035582 Oct 14 03:11:01.065338 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 258/506] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:01.116856 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-1285e4bc-760a-4968-bec1-c35ae99594ee tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:01.117520 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-1285e4bc-760a-4968-bec1-c35ae99594ee tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:01.124700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1285e4bc-760a-4968-bec1-c35ae99594ee tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:01.125250 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1285e4bc-760a-4968-bec1-c35ae99594ee tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:01.125694 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1285e4bc-760a-4968-bec1-c35ae99594ee tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:01.126443 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1285e4bc-760a-4968-bec1-c35ae99594ee tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:01.127423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1285e4bc-760a-4968-bec1-c35ae99594ee tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:01.127906 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1285e4bc-760a-4968-bec1-c35ae99594ee tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:01.299559 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fac63b9a-e030-41fb-92a5-a09921077ca1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:01.300704 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fac63b9a-e030-41fb-92a5-a09921077ca1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:01.303992 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1285e4bc-760a-4968-bec1-c35ae99594ee tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:01.313574 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fac63b9a-e030-41fb-92a5-a09921077ca1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:01.314013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fac63b9a-e030-41fb-92a5-a09921077ca1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:01.314467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fac63b9a-e030-41fb-92a5-a09921077ca1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:01.314962 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-1285e4bc-760a-4968-bec1-c35ae99594ee tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1683 microversion: 2.1 time: 0.202159 Oct 14 03:11:01.315177 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fac63b9a-e030-41fb-92a5-a09921077ca1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:01.316090 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 249/507] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:01 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1683 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:01.316932 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fac63b9a-e030-41fb-92a5-a09921077ca1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:01.317584 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fac63b9a-e030-41fb-92a5-a09921077ca1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:01.478773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fac63b9a-e030-41fb-92a5-a09921077ca1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:01.486593 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fac63b9a-e030-41fb-92a5-a09921077ca1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1677 microversion: 2.1 time: 0.191337 Oct 14 03:11:01.487156 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 259/508] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:01 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:02.340131 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-4813260f-239b-4bff-b8dc-441d0b0fae91 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:02.341386 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-4813260f-239b-4bff-b8dc-441d0b0fae91 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:02.348180 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=2 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:02.350689 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4813260f-239b-4bff-b8dc-441d0b0fae91 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:02.358101 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4813260f-239b-4bff-b8dc-441d0b0fae91 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:02.358101 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4813260f-239b-4bff-b8dc-441d0b0fae91 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:02.358101 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4813260f-239b-4bff-b8dc-441d0b0fae91 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:02.358101 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4813260f-239b-4bff-b8dc-441d0b0fae91 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:02.358627 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4813260f-239b-4bff-b8dc-441d0b0fae91 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:02.513576 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ea3cfe93-ebe0-4bb7-b8c1-9045ee4afd8d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:02.514209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ea3cfe93-ebe0-4bb7-b8c1-9045ee4afd8d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:02.518392 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4813260f-239b-4bff-b8dc-441d0b0fae91 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:02.527318 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea3cfe93-ebe0-4bb7-b8c1-9045ee4afd8d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:02.527604 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea3cfe93-ebe0-4bb7-b8c1-9045ee4afd8d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:02.527930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea3cfe93-ebe0-4bb7-b8c1-9045ee4afd8d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:02.528686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea3cfe93-ebe0-4bb7-b8c1-9045ee4afd8d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:02.529142 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea3cfe93-ebe0-4bb7-b8c1-9045ee4afd8d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:02.530381 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea3cfe93-ebe0-4bb7-b8c1-9045ee4afd8d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:02.537847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-4813260f-239b-4bff-b8dc-441d0b0fae91 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1683 microversion: 2.1 time: 0.202177 Oct 14 03:11:02.538664 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 250/509] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:02 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1683 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:02.703861 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ea3cfe93-ebe0-4bb7-b8c1-9045ee4afd8d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:02.712383 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ea3cfe93-ebe0-4bb7-b8c1-9045ee4afd8d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1677 microversion: 2.1 time: 0.202884 Oct 14 03:11:02.713591 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 260/510] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:02 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:03.561558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b379c47f-9916-442f-877c-af67123a0f0f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:03.562178 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b379c47f-9916-442f-877c-af67123a0f0f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:03.568682 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b379c47f-9916-442f-877c-af67123a0f0f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:03.569176 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b379c47f-9916-442f-877c-af67123a0f0f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:03.569622 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b379c47f-9916-442f-877c-af67123a0f0f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:03.570854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b379c47f-9916-442f-877c-af67123a0f0f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:03.571326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b379c47f-9916-442f-877c-af67123a0f0f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:03.571755 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b379c47f-9916-442f-877c-af67123a0f0f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:03.633570 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fdadbb31-ef36-4bb3-9649-c7aa1d3f86e1 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1294556805"}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:03.634226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fdadbb31-ef36-4bb3-9649-c7aa1d3f86e1 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:03.641973 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fdadbb31-ef36-4bb3-9649-c7aa1d3f86e1 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:03.642531 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fdadbb31-ef36-4bb3-9649-c7aa1d3f86e1 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:03.643129 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fdadbb31-ef36-4bb3-9649-c7aa1d3f86e1 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:03.643876 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fdadbb31-ef36-4bb3-9649-c7aa1d3f86e1 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:03.644339 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fdadbb31-ef36-4bb3-9649-c7aa1d3f86e1 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:03.644791 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fdadbb31-ef36-4bb3-9649-c7aa1d3f86e1 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:03.658373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b379c47f-9916-442f-877c-af67123a0f0f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:03.669619 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b379c47f-9916-442f-877c-af67123a0f0f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1615 microversion: 2.1 time: 0.112025 Oct 14 03:11:03.672957 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 251/511] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:03 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1615 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:03.686553 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-7c9682a2-01e8-4799-9dda-38bcd0357e56 req-e5028e24-9864-45ca-b2ee-4dee2da8f024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f00fbd-d2ed-4c85-b341-8b02b1c2c20d", "name": "network-vif-deleted", "tag": "26a9671e-04c8-470f-828a-9f6aa76bb214"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:03.697791 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-7c9682a2-01e8-4799-9dda-38bcd0357e56 req-e5028e24-9864-45ca-b2ee-4dee2da8f024 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:03.698509 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-7c9682a2-01e8-4799-9dda-38bcd0357e56 req-e5028e24-9864-45ca-b2ee-4dee2da8f024 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:03.699158 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-7c9682a2-01e8-4799-9dda-38bcd0357e56 req-e5028e24-9864-45ca-b2ee-4dee2da8f024 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:03.711804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-7c9682a2-01e8-4799-9dda-38bcd0357e56 req-e5028e24-9864-45ca-b2ee-4dee2da8f024 service nova] Creating event network-vif-deleted:26a9671e-04c8-470f-828a-9f6aa76bb214 for instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d on hv-cinder-80152 Oct 14 03:11:03.717593 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-7c9682a2-01e8-4799-9dda-38bcd0357e56 req-e5028e24-9864-45ca-b2ee-4dee2da8f024 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043120 Oct 14 03:11:03.722127 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 252/512] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:03.741250 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-45fc08fc-cc14-420c-bd08-a5a91c0ed4d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:03.741985 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-45fc08fc-cc14-420c-bd08-a5a91c0ed4d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:03.749732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45fc08fc-cc14-420c-bd08-a5a91c0ed4d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:03.750794 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45fc08fc-cc14-420c-bd08-a5a91c0ed4d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:03.753539 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45fc08fc-cc14-420c-bd08-a5a91c0ed4d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:03.753539 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45fc08fc-cc14-420c-bd08-a5a91c0ed4d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:03.753539 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45fc08fc-cc14-420c-bd08-a5a91c0ed4d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:03.753539 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45fc08fc-cc14-420c-bd08-a5a91c0ed4d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:03.911795 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.network.security_group_api [None req-fdadbb31-ef36-4bb3-9649-c7aa1d3f86e1 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Adding security group 6b0fe4d3-34b1-4ffb-a3d9-eb17dd591c8a to port fcb4f2b3-a43c-4d79-98f7-46d493d8d296 Oct 14 03:11:03.988751 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-45fc08fc-cc14-420c-bd08-a5a91c0ed4d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:03.997305 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-45fc08fc-cc14-420c-bd08-a5a91c0ed4d9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1677 microversion: 2.1 time: 0.264331 Oct 14 03:11:03.998118 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 253/513] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:03 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1677 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:04.382253 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fdadbb31-ef36-4bb3-9649-c7aa1d3f86e1 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "POST /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/action" status: 202 len: 0 microversion: 2.1 time: 0.752763 Oct 14 03:11:04.383716 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 261/514] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Oct 14 03:11:03 2022] POST /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/action => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:11:04.393111 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-4efa4189-1ac2-4665-af3d-eb703f487129 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:04.397980 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-4efa4189-1ac2-4665-af3d-eb703f487129 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:04.408426 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4efa4189-1ac2-4665-af3d-eb703f487129 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:04.409357 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4efa4189-1ac2-4665-af3d-eb703f487129 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:04.410058 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4efa4189-1ac2-4665-af3d-eb703f487129 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:04.410782 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4efa4189-1ac2-4665-af3d-eb703f487129 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:04.411297 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4efa4189-1ac2-4665-af3d-eb703f487129 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:04.412186 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4efa4189-1ac2-4665-af3d-eb703f487129 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:04.419443 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-82b74f04-bf0f-460f-9500-a4e9c418cf64 req-a6939bbc-4daa-4fda-a0ca-2b262fd846e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c3606f-b3fb-4249-b5fd-a2de8f5debc2", "tag": "fcb4f2b3-a43c-4d79-98f7-46d493d8d296"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:04.436982 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-82b74f04-bf0f-460f-9500-a4e9c418cf64 req-a6939bbc-4daa-4fda-a0ca-2b262fd846e1 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:04.440929 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-82b74f04-bf0f-460f-9500-a4e9c418cf64 req-a6939bbc-4daa-4fda-a0ca-2b262fd846e1 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:04.441657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-82b74f04-bf0f-460f-9500-a4e9c418cf64 req-a6939bbc-4daa-4fda-a0ca-2b262fd846e1 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:04.459952 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-82b74f04-bf0f-460f-9500-a4e9c418cf64 req-a6939bbc-4daa-4fda-a0ca-2b262fd846e1 service nova] Creating event network-changed:fcb4f2b3-a43c-4d79-98f7-46d493d8d296 for instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 on hv-cinder-80152 Oct 14 03:11:04.480071 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-82b74f04-bf0f-460f-9500-a4e9c418cf64 req-a6939bbc-4daa-4fda-a0ca-2b262fd846e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066293 Oct 14 03:11:04.484717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 262/515] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:04.580367 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4efa4189-1ac2-4665-af3d-eb703f487129 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:04.590484 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-4efa4189-1ac2-4665-af3d-eb703f487129 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1758 microversion: 2.1 time: 0.200898 Oct 14 03:11:04.595800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 254/516] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:04 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:04.699676 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fc63ef6b-b954-49ab-88a6-1eb8d1ee2844 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:04.700487 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fc63ef6b-b954-49ab-88a6-1eb8d1ee2844 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:04.707553 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc63ef6b-b954-49ab-88a6-1eb8d1ee2844 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:04.708040 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc63ef6b-b954-49ab-88a6-1eb8d1ee2844 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:04.708498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc63ef6b-b954-49ab-88a6-1eb8d1ee2844 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:04.709364 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc63ef6b-b954-49ab-88a6-1eb8d1ee2844 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:04.709966 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc63ef6b-b954-49ab-88a6-1eb8d1ee2844 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:04.710535 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc63ef6b-b954-49ab-88a6-1eb8d1ee2844 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:04.743937 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc63ef6b-b954-49ab-88a6-1eb8d1ee2844 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:04.744746 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc63ef6b-b954-49ab-88a6-1eb8d1ee2844 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:04.746168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc63ef6b-b954-49ab-88a6-1eb8d1ee2844 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:04.746331 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-fc63ef6b-b954-49ab-88a6-1eb8d1ee2844 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lazy-loading 'fault' on Instance uuid 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:04.793784 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fc63ef6b-b954-49ab-88a6-1eb8d1ee2844 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:04.802436 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fc63ef6b-b954-49ab-88a6-1eb8d1ee2844 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 200 len: 1332 microversion: 2.1 time: 0.108557 Oct 14 03:11:04.803564 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 263/517] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:04 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:05.024789 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-51051089-3566-454d-a9b1-35194f69830d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:05.025416 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-51051089-3566-454d-a9b1-35194f69830d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:05.032433 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-51051089-3566-454d-a9b1-35194f69830d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.033275 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-51051089-3566-454d-a9b1-35194f69830d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.033753 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-51051089-3566-454d-a9b1-35194f69830d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.034842 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-51051089-3566-454d-a9b1-35194f69830d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.035630 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-51051089-3566-454d-a9b1-35194f69830d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.036326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-51051089-3566-454d-a9b1-35194f69830d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.243839 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-51051089-3566-454d-a9b1-35194f69830d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:05.252013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-51051089-3566-454d-a9b1-35194f69830d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1677 microversion: 2.1 time: 0.231184 Oct 14 03:11:05.253436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 255/518] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:05 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:05.554289 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-84916b51-92a3-4eae-887a-5301dae144c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d161baf5-cb1b-4b1a-84fc-0437d6ba38b1"}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:05.557029 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-84916b51-92a3-4eae-887a-5301dae144c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:05.563925 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-84916b51-92a3-4eae-887a-5301dae144c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.564446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-84916b51-92a3-4eae-887a-5301dae144c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.564929 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-84916b51-92a3-4eae-887a-5301dae144c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.565895 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-84916b51-92a3-4eae-887a-5301dae144c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.566395 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-84916b51-92a3-4eae-887a-5301dae144c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.567079 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-84916b51-92a3-4eae-887a-5301dae144c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.585327 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:05.827392 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8cb058a8-09c7-487e-867a-5eb200081ebf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:05.828036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8cb058a8-09c7-487e-867a-5eb200081ebf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:05.830670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:05.835299 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8cb058a8-09c7-487e-867a-5eb200081ebf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.835775 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8cb058a8-09c7-487e-867a-5eb200081ebf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.836209 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8cb058a8-09c7-487e-867a-5eb200081ebf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.838349 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8cb058a8-09c7-487e-867a-5eb200081ebf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.838349 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8cb058a8-09c7-487e-867a-5eb200081ebf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.838608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8cb058a8-09c7-487e-867a-5eb200081ebf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.854214 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-8cb058a8-09c7-487e-867a-5eb200081ebf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] HTTP exception thrown: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8cb058a8-09c7-487e-867a-5eb200081ebf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Request method failure captured: Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d HTTP/1.1 Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKG-ky05sope_YdGjGweAljK5FUxzsY0TE3JqS7jM4jPzALKbCEnItlHGzo5Xg-IOfB8MCgv3mdaVNqvdBnmYZMENHyFWRo7_9tNs76BHsJnl6Osbo5VySDApF7HiliGWSEh0OSOTvdEIMsVWp5oVBM2GccEYCsyuR5X3gKYrX8g9g Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:11:05.855868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:11:05.857436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:11:05.857436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:11:05.857436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:11:05.857436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:11:05.857436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:11:05.857436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:11:05.857436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:11:05.857436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 4553b7573ca34af6a9fdb94f80717f24 Oct 14 03:11:05.857436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:11:05.857436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:11:05.857436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:11:05.857436 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': '95f00fbd-d2ed-4c85-b341-8b02b1c2c20d'} Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:11:05.858303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:11:05.859705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:11:05.867628 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8cb058a8-09c7-487e-867a-5eb200081ebf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Returning 404 to user: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:11:05.867628 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8cb058a8-09c7-487e-867a-5eb200081ebf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 404 len: 111 microversion: 2.1 time: 0.033748 Oct 14 03:11:05.867628 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 256/519] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:05 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:11:05.867628 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-bae15859-2ffa-4624-8ad4-26dbfa502fd8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '.version_select at 0x7fdcc7575d30>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:05.978108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-bae15859-2ffa-4624-8ad4-26dbfa502fd8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730797856" status: 202 len: 0 microversion: 2.1 time: 0.115606 Oct 14 03:11:05.978707 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 257/520] 10.222.0.13 () {58 vars in 1221 bytes} [Fri Oct 14 03:11:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730797856 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 03:11:06.275809 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c9c3cacd-b9c4-4b5d-ad96-4f93fc0c44b4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:06.276438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c9c3cacd-b9c4-4b5d-ad96-4f93fc0c44b4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:06.283585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c9c3cacd-b9c4-4b5d-ad96-4f93fc0c44b4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:06.284970 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c9c3cacd-b9c4-4b5d-ad96-4f93fc0c44b4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:06.285419 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c9c3cacd-b9c4-4b5d-ad96-4f93fc0c44b4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:06.286143 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c9c3cacd-b9c4-4b5d-ad96-4f93fc0c44b4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:06.286605 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c9c3cacd-b9c4-4b5d-ad96-4f93fc0c44b4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:06.287149 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c9c3cacd-b9c4-4b5d-ad96-4f93fc0c44b4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:06.313436 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-84916b51-92a3-4eae-887a-5301dae144c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "POST /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.762855 Oct 14 03:11:06.319942 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 264/521] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Oct 14 03:11:05 2022] POST /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments => generated 194 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:06.523168 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c9c3cacd-b9c4-4b5d-ad96-4f93fc0c44b4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:06.530780 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c9c3cacd-b9c4-4b5d-ad96-4f93fc0c44b4 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1654 microversion: 2.1 time: 0.259495 Oct 14 03:11:06.531352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 258/522] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:06 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1654 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:06.555545 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e06ab133-e8ff-41df-a665-afea866e2b8a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:06.563240 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e06ab133-e8ff-41df-a665-afea866e2b8a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:06.563863 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e06ab133-e8ff-41df-a665-afea866e2b8a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:06.564506 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e06ab133-e8ff-41df-a665-afea866e2b8a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:06.592813 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e06ab133-e8ff-41df-a665-afea866e2b8a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Going to try to start instance {{(pid=119301) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 14 03:11:06.780997 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e06ab133-e8ff-41df-a665-afea866e2b8a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "POST /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/action" status: 202 len: 0 microversion: 2.1 time: 0.230739 Oct 14 03:11:06.791583 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 265/523] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Oct 14 03:11:06 2022] POST /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:11:06.791742 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-fdb9cb1f-3951-4f7a-a98b-dcc7caf73d66 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:06.791742 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-fdb9cb1f-3951-4f7a-a98b-dcc7caf73d66 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:06.797637 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdb9cb1f-3951-4f7a-a98b-dcc7caf73d66 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:06.798083 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdb9cb1f-3951-4f7a-a98b-dcc7caf73d66 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:06.798593 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdb9cb1f-3951-4f7a-a98b-dcc7caf73d66 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:06.799369 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdb9cb1f-3951-4f7a-a98b-dcc7caf73d66 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:06.799951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdb9cb1f-3951-4f7a-a98b-dcc7caf73d66 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:06.800395 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdb9cb1f-3951-4f7a-a98b-dcc7caf73d66 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:06.867672 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b36e77f0-df06-4bef-a1f6-87d1b0a76093 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Action: 'create', calling method: .version_select at 0x7fdcc769e3a0>, body: {"keypair": {"name": "tempest-keypair-489287594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFx1sJ1d+FwUB6/SHkhOowSl659LDMnfURsSwvZlXZI0vymJESzSAwF7LkV85JufGX4UeEjcW9wUQz4crtIkC+g+0bO746gTHjqJiXYfgPbllTvtIHyt+u6R8WMBkQg6w=="}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:06.886634 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-b36e77f0-df06-4bef-a1f6-87d1b0a76093 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:11:06.890521 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-b36e77f0-df06-4bef-a1f6-87d1b0a76093 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for user 4553b7573ca34af6a9fdb94f80717f24 and project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:11:06.950611 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-fdb9cb1f-3951-4f7a-a98b-dcc7caf73d66 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:06.958642 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-fdb9cb1f-3951-4f7a-a98b-dcc7caf73d66 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1663 microversion: 2.1 time: 0.172632 Oct 14 03:11:06.959211 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 259/524] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:06 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1663 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:06.979363 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b36e77f0-df06-4bef-a1f6-87d1b0a76093 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116037 Oct 14 03:11:06.979984 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 266/525] 10.222.0.13 () {60 vars in 1159 bytes} [Fri Oct 14 03:11:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:11:07.981691 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b2e7142a-dec5-4d5a-a81d-e231c1f4fb18 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:07.982306 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b2e7142a-dec5-4d5a-a81d-e231c1f4fb18 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:07.988730 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b2e7142a-dec5-4d5a-a81d-e231c1f4fb18 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:07.989213 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b2e7142a-dec5-4d5a-a81d-e231c1f4fb18 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:07.989644 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b2e7142a-dec5-4d5a-a81d-e231c1f4fb18 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:07.990329 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b2e7142a-dec5-4d5a-a81d-e231c1f4fb18 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:07.990782 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b2e7142a-dec5-4d5a-a81d-e231c1f4fb18 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:07.991202 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b2e7142a-dec5-4d5a-a81d-e231c1f4fb18 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:08.127312 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b2e7142a-dec5-4d5a-a81d-e231c1f4fb18 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:08.135340 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b2e7142a-dec5-4d5a-a81d-e231c1f4fb18 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1663 microversion: 2.1 time: 0.157432 Oct 14 03:11:08.135938 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 260/526] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:07 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:08.575306 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-02a8210a-1df1-45c1-a37d-f465b140f10d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:08.577700 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-02a8210a-1df1-45c1-a37d-f465b140f10d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:08.585651 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-02a8210a-1df1-45c1-a37d-f465b140f10d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:08.586143 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-02a8210a-1df1-45c1-a37d-f465b140f10d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:08.586619 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-02a8210a-1df1-45c1-a37d-f465b140f10d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:08.587328 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-02a8210a-1df1-45c1-a37d-f465b140f10d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:08.587815 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-02a8210a-1df1-45c1-a37d-f465b140f10d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:08.588826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-02a8210a-1df1-45c1-a37d-f465b140f10d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:08.613958 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-02a8210a-1df1-45c1-a37d-f465b140f10d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lazy-loading 'flavor' on Instance uuid a2ae6b50-1d01-420e-ab83-6c856e0b35d4 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:09.023326 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-02a8210a-1df1-45c1-a37d-f465b140f10d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "POST /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/action" status: 200 len: 32 microversion: 2.1 time: 0.452572 Oct 14 03:11:09.023917 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 267/527] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Oct 14 03:11:08 2022] POST /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/action => generated 32 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:11:09.034047 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-7ac87217-9ae6-41b2-9fc5-78376cdf1a8d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:09.035217 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-7ac87217-9ae6-41b2-9fc5-78376cdf1a8d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:09.042025 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7ac87217-9ae6-41b2-9fc5-78376cdf1a8d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:09.042767 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7ac87217-9ae6-41b2-9fc5-78376cdf1a8d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:09.043429 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7ac87217-9ae6-41b2-9fc5-78376cdf1a8d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:09.044202 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7ac87217-9ae6-41b2-9fc5-78376cdf1a8d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:09.044731 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7ac87217-9ae6-41b2-9fc5-78376cdf1a8d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:09.045189 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7ac87217-9ae6-41b2-9fc5-78376cdf1a8d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:09.159603 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-26e802f6-f41a-4e07-acf1-09c1375b8228 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:09.160621 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-26e802f6-f41a-4e07-acf1-09c1375b8228 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:09.168032 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-26e802f6-f41a-4e07-acf1-09c1375b8228 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:09.168555 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-26e802f6-f41a-4e07-acf1-09c1375b8228 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:09.168996 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-26e802f6-f41a-4e07-acf1-09c1375b8228 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:09.169701 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-26e802f6-f41a-4e07-acf1-09c1375b8228 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:09.170238 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-26e802f6-f41a-4e07-acf1-09c1375b8228 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:09.170843 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-26e802f6-f41a-4e07-acf1-09c1375b8228 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:09.176957 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7ac87217-9ae6-41b2-9fc5-78376cdf1a8d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:09.181100 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:09.194121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-7ac87217-9ae6-41b2-9fc5-78376cdf1a8d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.163966 Oct 14 03:11:09.208716 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 261/528] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:09 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:09.315878 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-26e802f6-f41a-4e07-acf1-09c1375b8228 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:09.324261 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-26e802f6-f41a-4e07-acf1-09c1375b8228 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1663 microversion: 2.1 time: 0.169261 Oct 14 03:11:09.324874 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 268/529] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:09 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:09.599442 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-246969713", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fcf48d6-7187-4929-b5fb-8bc693b44fb9"}], "security_groups": [{"name": "tempest-securitygroup--227207519"}], "key_name": "tempest-keypair-489287594", "user_data": "}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:09.704083 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.network.neutron [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] validate_networks() for [('9fcf48d6-7187-4929-b5fb-8bc693b44fb9', None, None, None, None, None)] {{(pid=119302) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:11:10.077691 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Flavor limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:11:10.078277 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Image limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:11:10.078579 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Flavor pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:11:10.079011 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Image pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:11:10.079401 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:11:10.088479 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:10.089513 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:10.089957 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:10.090695 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:10.091155 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:10.091591 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:10.108710 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:11:10.112601 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for user 4553b7573ca34af6a9fdb94f80717f24 and project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:11:10.124042 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Going to run 1 instances... {{(pid=119302) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:11:10.126486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:11:10.219115 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fc1d4e8f-15d9-466c-be3c-1a082b8014d9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:10.219918 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fc1d4e8f-15d9-466c-be3c-1a082b8014d9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:10.226447 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc1d4e8f-15d9-466c-be3c-1a082b8014d9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:10.226935 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc1d4e8f-15d9-466c-be3c-1a082b8014d9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:10.227374 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc1d4e8f-15d9-466c-be3c-1a082b8014d9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:10.230473 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc1d4e8f-15d9-466c-be3c-1a082b8014d9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:10.231374 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc1d4e8f-15d9-466c-be3c-1a082b8014d9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:10.231827 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc1d4e8f-15d9-466c-be3c-1a082b8014d9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:10.246528 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-919de384-2bd6-40cb-905d-14dfa1cd9be7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.651389 Oct 14 03:11:10.247844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 262/530] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:11:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:11:10.258759 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3ca567f5-fc14-498f-8fc2-febe65374af6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:10.259638 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-3ca567f5-fc14-498f-8fc2-febe65374af6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:10.338455 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3ca567f5-fc14-498f-8fc2-febe65374af6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:10.348857 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-3ca567f5-fc14-498f-8fc2-febe65374af6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1240 microversion: 2.1 time: 0.093745 Oct 14 03:11:10.361778 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 263/531] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:10 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:10.366839 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9b9913d4-16c9-4763-9b5b-bec68c9f9159 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:10.367511 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9b9913d4-16c9-4763-9b5b-bec68c9f9159 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:10.378340 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b9913d4-16c9-4763-9b5b-bec68c9f9159 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:10.379264 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b9913d4-16c9-4763-9b5b-bec68c9f9159 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:10.379706 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b9913d4-16c9-4763-9b5b-bec68c9f9159 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:10.381576 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b9913d4-16c9-4763-9b5b-bec68c9f9159 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:10.382877 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b9913d4-16c9-4763-9b5b-bec68c9f9159 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:10.383312 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b9913d4-16c9-4763-9b5b-bec68c9f9159 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:10.419999 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fc1d4e8f-15d9-466c-be3c-1a082b8014d9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:10.429319 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fc1d4e8f-15d9-466c-be3c-1a082b8014d9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.213953 Oct 14 03:11:10.430038 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 269/532] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:10 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:10.535752 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9b9913d4-16c9-4763-9b5b-bec68c9f9159 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:10.543770 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9b9913d4-16c9-4763-9b5b-bec68c9f9159 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1667 microversion: 2.1 time: 0.192235 Oct 14 03:11:10.544363 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 264/533] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:10 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1667 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:11.372481 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-af78b1d8-db68-4146-8be9-e50ddb334ddf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:11.373145 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-af78b1d8-db68-4146-8be9-e50ddb334ddf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:11.379356 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af78b1d8-db68-4146-8be9-e50ddb334ddf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:11.381908 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af78b1d8-db68-4146-8be9-e50ddb334ddf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:11.381908 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af78b1d8-db68-4146-8be9-e50ddb334ddf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:11.381908 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af78b1d8-db68-4146-8be9-e50ddb334ddf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:11.381908 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af78b1d8-db68-4146-8be9-e50ddb334ddf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:11.382309 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af78b1d8-db68-4146-8be9-e50ddb334ddf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:11.442927 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-af78b1d8-db68-4146-8be9-e50ddb334ddf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:11.449063 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-af78b1d8-db68-4146-8be9-e50ddb334ddf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1244 microversion: 2.1 time: 0.080974 Oct 14 03:11:11.449640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 270/534] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:11 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:11.454847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-eb928793-1cde-4524-9fd1-ebb9f6faef1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:11.455456 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-eb928793-1cde-4524-9fd1-ebb9f6faef1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:11.462188 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-eb928793-1cde-4524-9fd1-ebb9f6faef1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:11.462670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-eb928793-1cde-4524-9fd1-ebb9f6faef1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:11.463145 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-eb928793-1cde-4524-9fd1-ebb9f6faef1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:11.463869 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-eb928793-1cde-4524-9fd1-ebb9f6faef1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:11.464301 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-eb928793-1cde-4524-9fd1-ebb9f6faef1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:11.465259 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-eb928793-1cde-4524-9fd1-ebb9f6faef1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:11.604199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-eb928793-1cde-4524-9fd1-ebb9f6faef1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:11.613332 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-eb928793-1cde-4524-9fd1-ebb9f6faef1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.162402 Oct 14 03:11:11.613907 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 265/535] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:11 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:11.938997 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-6b1dcaf0-81a9-4b13-a8dd-b7a9b4fa01a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d6e0af2-23bd-49ab-94eb-9ee6ab702d92", "device": "/dev/sdb"}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:11.942041 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-6b1dcaf0-81a9-4b13-a8dd-b7a9b4fa01a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:11.948017 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6b1dcaf0-81a9-4b13-a8dd-b7a9b4fa01a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:11.948574 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6b1dcaf0-81a9-4b13-a8dd-b7a9b4fa01a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:11.949003 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6b1dcaf0-81a9-4b13-a8dd-b7a9b4fa01a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:11.950232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6b1dcaf0-81a9-4b13-a8dd-b7a9b4fa01a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:11.950682 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6b1dcaf0-81a9-4b13-a8dd-b7a9b4fa01a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:11.951099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6b1dcaf0-81a9-4b13-a8dd-b7a9b4fa01a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:12.471265 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-64efff17-a750-4e82-8b83-5e238292e973 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:12.471907 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-64efff17-a750-4e82-8b83-5e238292e973 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:12.478324 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-64efff17-a750-4e82-8b83-5e238292e973 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:12.478800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-64efff17-a750-4e82-8b83-5e238292e973 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:12.479231 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-64efff17-a750-4e82-8b83-5e238292e973 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:12.479914 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-64efff17-a750-4e82-8b83-5e238292e973 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:12.480366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-64efff17-a750-4e82-8b83-5e238292e973 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:12.480809 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-64efff17-a750-4e82-8b83-5e238292e973 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:12.542289 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-64efff17-a750-4e82-8b83-5e238292e973 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:12.550352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-64efff17-a750-4e82-8b83-5e238292e973 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1292 microversion: 2.1 time: 0.082839 Oct 14 03:11:12.554689 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 266/536] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:12 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:12.636103 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-66274538-712e-4e6d-8cce-153cb0f4ac7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:12.636699 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-66274538-712e-4e6d-8cce-153cb0f4ac7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:12.642664 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66274538-712e-4e6d-8cce-153cb0f4ac7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:12.650660 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66274538-712e-4e6d-8cce-153cb0f4ac7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:12.650660 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66274538-712e-4e6d-8cce-153cb0f4ac7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:12.650660 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66274538-712e-4e6d-8cce-153cb0f4ac7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:12.650660 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66274538-712e-4e6d-8cce-153cb0f4ac7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:12.651082 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66274538-712e-4e6d-8cce-153cb0f4ac7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:12.651179 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-6b1dcaf0-81a9-4b13-a8dd-b7a9b4fa01a2 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "POST /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.711383 Oct 14 03:11:12.651179 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 271/537] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Oct 14 03:11:11 2022] POST /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a/os-volume_attachments => generated 194 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:12.780897 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-66274538-712e-4e6d-8cce-153cb0f4ac7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:12.789105 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-66274538-712e-4e6d-8cce-153cb0f4ac7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.156929 Oct 14 03:11:12.789679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 267/538] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:12 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:13.574516 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-59c1766d-3648-4745-96a4-8a504c98a1c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:13.575715 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-59c1766d-3648-4745-96a4-8a504c98a1c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:13.582359 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59c1766d-3648-4745-96a4-8a504c98a1c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:13.583087 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59c1766d-3648-4745-96a4-8a504c98a1c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:13.583562 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59c1766d-3648-4745-96a4-8a504c98a1c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:13.584466 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59c1766d-3648-4745-96a4-8a504c98a1c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:13.584915 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59c1766d-3648-4745-96a4-8a504c98a1c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:13.585337 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59c1766d-3648-4745-96a4-8a504c98a1c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:13.649195 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-59c1766d-3648-4745-96a4-8a504c98a1c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:13.657027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-59c1766d-3648-4745-96a4-8a504c98a1c4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1298 microversion: 2.1 time: 0.086660 Oct 14 03:11:13.657598 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 272/539] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:13 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:13.813404 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-802a4077-d0dc-48cc-9dd1-0ed9e17a386b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:13.814022 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-802a4077-d0dc-48cc-9dd1-0ed9e17a386b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:13.820794 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-802a4077-d0dc-48cc-9dd1-0ed9e17a386b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:13.821281 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-802a4077-d0dc-48cc-9dd1-0ed9e17a386b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:13.821742 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-802a4077-d0dc-48cc-9dd1-0ed9e17a386b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:13.822448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-802a4077-d0dc-48cc-9dd1-0ed9e17a386b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:13.822978 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-802a4077-d0dc-48cc-9dd1-0ed9e17a386b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:13.823413 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-802a4077-d0dc-48cc-9dd1-0ed9e17a386b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:13.957677 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-802a4077-d0dc-48cc-9dd1-0ed9e17a386b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:13.966121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-802a4077-d0dc-48cc-9dd1-0ed9e17a386b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.157141 Oct 14 03:11:13.966731 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 268/540] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:13 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:14.680472 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-7af47b9a-0671-40a2-ab01-c2512d1afd66 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:14.683396 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-7af47b9a-0671-40a2-ab01-c2512d1afd66 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:14.687352 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7af47b9a-0671-40a2-ab01-c2512d1afd66 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:14.687835 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7af47b9a-0671-40a2-ab01-c2512d1afd66 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:14.688273 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7af47b9a-0671-40a2-ab01-c2512d1afd66 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:14.688996 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7af47b9a-0671-40a2-ab01-c2512d1afd66 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:14.689449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7af47b9a-0671-40a2-ab01-c2512d1afd66 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:14.689878 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7af47b9a-0671-40a2-ab01-c2512d1afd66 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:14.822024 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-7af47b9a-0671-40a2-ab01-c2512d1afd66 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:14.832993 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-7af47b9a-0671-40a2-ab01-c2512d1afd66 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1365 microversion: 2.1 time: 0.155818 Oct 14 03:11:14.833783 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 273/541] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:14 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:14.860832 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-82177772-d5ef-4939-a9ad-c5b00d5b25f1 req-ac6193cb-3049-4ea2-aa63-6a99d8e2534f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3200a8b9-6447-41fb-8433-36b0283813ee", "tag": "54331d2d-aa76-4594-90ce-8cefce821aa5"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:14.871074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-82177772-d5ef-4939-a9ad-c5b00d5b25f1 req-ac6193cb-3049-4ea2-aa63-6a99d8e2534f service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:14.871643 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-82177772-d5ef-4939-a9ad-c5b00d5b25f1 req-ac6193cb-3049-4ea2-aa63-6a99d8e2534f service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:14.872178 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-82177772-d5ef-4939-a9ad-c5b00d5b25f1 req-ac6193cb-3049-4ea2-aa63-6a99d8e2534f service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:14.886513 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-82177772-d5ef-4939-a9ad-c5b00d5b25f1 req-ac6193cb-3049-4ea2-aa63-6a99d8e2534f service nova] Creating event network-changed:54331d2d-aa76-4594-90ce-8cefce821aa5 for instance 3200a8b9-6447-41fb-8433-36b0283813ee on hv-cinder-80152 Oct 14 03:11:14.888985 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-82177772-d5ef-4939-a9ad-c5b00d5b25f1 req-ac6193cb-3049-4ea2-aa63-6a99d8e2534f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031273 Oct 14 03:11:14.889690 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 269/542] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:14.989721 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-19b592b3-a782-4d69-8fe0-07ad8030194b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:14.990565 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-19b592b3-a782-4d69-8fe0-07ad8030194b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:14.996586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-19b592b3-a782-4d69-8fe0-07ad8030194b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:14.997070 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-19b592b3-a782-4d69-8fe0-07ad8030194b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:14.997537 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-19b592b3-a782-4d69-8fe0-07ad8030194b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:14.998209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-19b592b3-a782-4d69-8fe0-07ad8030194b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:14.998669 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-19b592b3-a782-4d69-8fe0-07ad8030194b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:14.999092 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-19b592b3-a782-4d69-8fe0-07ad8030194b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:15.134568 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-19b592b3-a782-4d69-8fe0-07ad8030194b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:15.143615 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-19b592b3-a782-4d69-8fe0-07ad8030194b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.158033 Oct 14 03:11:15.144102 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 274/543] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:14 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:15.856875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2fe844a3-aa7e-491d-935e-cfb0b2f8aecf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:15.858114 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2fe844a3-aa7e-491d-935e-cfb0b2f8aecf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:15.864070 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2fe844a3-aa7e-491d-935e-cfb0b2f8aecf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:15.864684 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2fe844a3-aa7e-491d-935e-cfb0b2f8aecf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:15.865106 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2fe844a3-aa7e-491d-935e-cfb0b2f8aecf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:15.865728 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2fe844a3-aa7e-491d-935e-cfb0b2f8aecf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:15.866183 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2fe844a3-aa7e-491d-935e-cfb0b2f8aecf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:15.866604 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2fe844a3-aa7e-491d-935e-cfb0b2f8aecf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:15.995434 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2fe844a3-aa7e-491d-935e-cfb0b2f8aecf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:16.003147 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2fe844a3-aa7e-491d-935e-cfb0b2f8aecf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1365 microversion: 2.1 time: 0.150624 Oct 14 03:11:16.003804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 270/544] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:15 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:16.166798 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-cd18f0b4-a2dc-455d-b112-81e6a84b994c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:16.167412 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-cd18f0b4-a2dc-455d-b112-81e6a84b994c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:16.170750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:16.175405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cd18f0b4-a2dc-455d-b112-81e6a84b994c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:16.175896 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cd18f0b4-a2dc-455d-b112-81e6a84b994c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:16.176338 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cd18f0b4-a2dc-455d-b112-81e6a84b994c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:16.177069 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cd18f0b4-a2dc-455d-b112-81e6a84b994c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:16.177523 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cd18f0b4-a2dc-455d-b112-81e6a84b994c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:16.177950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cd18f0b4-a2dc-455d-b112-81e6a84b994c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:16.314934 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-cd18f0b4-a2dc-455d-b112-81e6a84b994c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:16.323724 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-cd18f0b4-a2dc-455d-b112-81e6a84b994c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.160763 Oct 14 03:11:16.324331 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 275/545] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:16 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:16.995422 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-9280e18e-7201-4a2e-bc3c-dc5bcaaf369a req-d917a2b3-ecb5-4b83-9acf-1906e3f7544d admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "1d6e0af2-23bd-49ab-94eb-9ee6ab702d92", "create_info": {"type": "qcow2", "new_file": "volume-1d6e0af2-23bd-49ab-94eb-9ee6ab702d92.2cca88ab-a027-41bb-bd77-886bddf1b5cd.vhdx", "snapshot_id": "2cca88ab-a027-41bb-bd77-886bddf1b5cd"}}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:17.004106 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [req-9280e18e-7201-4a2e-bc3c-dc5bcaaf369a req-d917a2b3-ecb5-4b83-9acf-1906e3f7544d admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e228678d-bf1f-4de4-9ba4-dd43fa30f246(cell1) {{(pid=119302) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 14 03:11:17.004616 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-9280e18e-7201-4a2e-bc3c-dc5bcaaf369a req-d917a2b3-ecb5-4b83-9acf-1906e3f7544d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:17.005096 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-9280e18e-7201-4a2e-bc3c-dc5bcaaf369a req-d917a2b3-ecb5-4b83-9acf-1906e3f7544d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:17.005531 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-9280e18e-7201-4a2e-bc3c-dc5bcaaf369a req-d917a2b3-ecb5-4b83-9acf-1906e3f7544d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:17.025060 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f5ea8994-3f02-49a8-a745-223a3aafb72f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:17.025668 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f5ea8994-3f02-49a8-a745-223a3aafb72f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:17.027849 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=4 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:17.033342 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5ea8994-3f02-49a8-a745-223a3aafb72f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:17.033342 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5ea8994-3f02-49a8-a745-223a3aafb72f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:17.033577 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5ea8994-3f02-49a8-a745-223a3aafb72f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:17.034199 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5ea8994-3f02-49a8-a745-223a3aafb72f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:17.034647 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5ea8994-3f02-49a8-a745-223a3aafb72f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:17.035066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5ea8994-3f02-49a8-a745-223a3aafb72f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:17.039969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-9280e18e-7201-4a2e-bc3c-dc5bcaaf369a req-d917a2b3-ecb5-4b83-9acf-1906e3f7544d admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:17.042855 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-9280e18e-7201-4a2e-bc3c-dc5bcaaf369a req-d917a2b3-ecb5-4b83-9acf-1906e3f7544d admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:17.042855 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-9280e18e-7201-4a2e-bc3c-dc5bcaaf369a req-d917a2b3-ecb5-4b83-9acf-1906e3f7544d admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:17.053085 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:17.065148 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-9280e18e-7201-4a2e-bc3c-dc5bcaaf369a req-d917a2b3-ecb5-4b83-9acf-1906e3f7544d admin admin] 10.222.0.44 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.124613 Oct 14 03:11:17.066151 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 271/546] 10.222.0.44 () {64 vars in 1326 bytes} [Fri Oct 14 03:11:16 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:11:17.163862 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f5ea8994-3f02-49a8-a745-223a3aafb72f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:17.172508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f5ea8994-3f02-49a8-a745-223a3aafb72f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1365 microversion: 2.1 time: 0.151201 Oct 14 03:11:17.173087 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 276/547] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:17 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:17.352495 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-98255b5a-69f7-4311-b985-143006ea0256 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:17.353220 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-98255b5a-69f7-4311-b985-143006ea0256 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:17.359802 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-98255b5a-69f7-4311-b985-143006ea0256 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:17.360288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-98255b5a-69f7-4311-b985-143006ea0256 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:17.360760 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-98255b5a-69f7-4311-b985-143006ea0256 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:17.361641 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-98255b5a-69f7-4311-b985-143006ea0256 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:17.362102 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-98255b5a-69f7-4311-b985-143006ea0256 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:17.362535 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-98255b5a-69f7-4311-b985-143006ea0256 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:17.494446 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-98255b5a-69f7-4311-b985-143006ea0256 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:17.502497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-98255b5a-69f7-4311-b985-143006ea0256 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.154263 Oct 14 03:11:17.503274 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 272/548] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:17 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:18.195679 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e2205252-e267-4dfa-be89-c6d09d75b313 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:18.196320 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e2205252-e267-4dfa-be89-c6d09d75b313 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:18.202684 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e2205252-e267-4dfa-be89-c6d09d75b313 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:18.203165 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e2205252-e267-4dfa-be89-c6d09d75b313 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:18.203602 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e2205252-e267-4dfa-be89-c6d09d75b313 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:18.204289 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e2205252-e267-4dfa-be89-c6d09d75b313 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:18.204768 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e2205252-e267-4dfa-be89-c6d09d75b313 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:18.205195 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e2205252-e267-4dfa-be89-c6d09d75b313 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:18.329461 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-e2205252-e267-4dfa-be89-c6d09d75b313 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:18.337512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e2205252-e267-4dfa-be89-c6d09d75b313 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1365 microversion: 2.1 time: 0.145581 Oct 14 03:11:18.338098 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 277/549] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:18 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:18.525577 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-1c646f60-b20a-4c50-8f4a-0564d6f079af tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:18.526117 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-1c646f60-b20a-4c50-8f4a-0564d6f079af tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:18.533306 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1c646f60-b20a-4c50-8f4a-0564d6f079af tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:18.533787 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1c646f60-b20a-4c50-8f4a-0564d6f079af tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:18.534223 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1c646f60-b20a-4c50-8f4a-0564d6f079af tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:18.534907 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1c646f60-b20a-4c50-8f4a-0564d6f079af tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:18.535363 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1c646f60-b20a-4c50-8f4a-0564d6f079af tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:18.535786 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1c646f60-b20a-4c50-8f4a-0564d6f079af tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:18.662722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1c646f60-b20a-4c50-8f4a-0564d6f079af tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:18.670940 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-1c646f60-b20a-4c50-8f4a-0564d6f079af tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.149355 Oct 14 03:11:18.671522 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 273/550] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:18 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:19.360648 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9a3ceeb8-e402-452b-ac18-d6964a62ba05 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:19.361264 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-9a3ceeb8-e402-452b-ac18-d6964a62ba05 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:19.367829 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9a3ceeb8-e402-452b-ac18-d6964a62ba05 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:19.368287 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9a3ceeb8-e402-452b-ac18-d6964a62ba05 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:19.368780 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9a3ceeb8-e402-452b-ac18-d6964a62ba05 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:19.369478 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9a3ceeb8-e402-452b-ac18-d6964a62ba05 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:19.369936 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9a3ceeb8-e402-452b-ac18-d6964a62ba05 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:19.370366 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9a3ceeb8-e402-452b-ac18-d6964a62ba05 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:19.494353 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-9a3ceeb8-e402-452b-ac18-d6964a62ba05 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:19.502037 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9a3ceeb8-e402-452b-ac18-d6964a62ba05 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1365 microversion: 2.1 time: 0.145267 Oct 14 03:11:19.502600 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 278/551] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:19 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:19.694276 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-05c3534d-f2f7-4f7b-8556-4c7d87c37781 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:19.694984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-05c3534d-f2f7-4f7b-8556-4c7d87c37781 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:19.701450 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-05c3534d-f2f7-4f7b-8556-4c7d87c37781 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:19.701942 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-05c3534d-f2f7-4f7b-8556-4c7d87c37781 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:19.702390 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-05c3534d-f2f7-4f7b-8556-4c7d87c37781 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:19.703767 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-05c3534d-f2f7-4f7b-8556-4c7d87c37781 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:19.704227 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-05c3534d-f2f7-4f7b-8556-4c7d87c37781 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:19.704717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-05c3534d-f2f7-4f7b-8556-4c7d87c37781 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:19.836886 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-05c3534d-f2f7-4f7b-8556-4c7d87c37781 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:19.845087 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-05c3534d-f2f7-4f7b-8556-4c7d87c37781 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.154828 Oct 14 03:11:19.845664 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 274/552] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:19 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:20.524847 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-730afe2d-3848-4663-a87d-c6f68479a3aa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:20.525489 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-730afe2d-3848-4663-a87d-c6f68479a3aa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:20.532368 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-730afe2d-3848-4663-a87d-c6f68479a3aa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:20.532901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-730afe2d-3848-4663-a87d-c6f68479a3aa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:20.533338 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-730afe2d-3848-4663-a87d-c6f68479a3aa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:20.534036 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-730afe2d-3848-4663-a87d-c6f68479a3aa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:20.534493 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-730afe2d-3848-4663-a87d-c6f68479a3aa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:20.534919 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-730afe2d-3848-4663-a87d-c6f68479a3aa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:20.661600 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-730afe2d-3848-4663-a87d-c6f68479a3aa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:20.669164 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-730afe2d-3848-4663-a87d-c6f68479a3aa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1365 microversion: 2.1 time: 0.148275 Oct 14 03:11:20.669737 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 279/553] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:20 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:20.867716 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e5763339-4451-4936-8c94-a977b2d9cad7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:20.868342 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e5763339-4451-4936-8c94-a977b2d9cad7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:20.870327 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=8 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:20.875573 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e5763339-4451-4936-8c94-a977b2d9cad7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:20.876051 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e5763339-4451-4936-8c94-a977b2d9cad7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:20.876519 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e5763339-4451-4936-8c94-a977b2d9cad7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:20.877207 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e5763339-4451-4936-8c94-a977b2d9cad7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:20.877660 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e5763339-4451-4936-8c94-a977b2d9cad7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:20.879754 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e5763339-4451-4936-8c94-a977b2d9cad7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:21.002820 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e5763339-4451-4936-8c94-a977b2d9cad7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:21.010997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e5763339-4451-4936-8c94-a977b2d9cad7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.147246 Oct 14 03:11:21.011567 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 275/554] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:20 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:21.692988 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-121376ca-e52a-4490-8bb6-8df24143468b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:21.693672 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-121376ca-e52a-4490-8bb6-8df24143468b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:21.700065 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-121376ca-e52a-4490-8bb6-8df24143468b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:21.700593 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-121376ca-e52a-4490-8bb6-8df24143468b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:21.701030 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-121376ca-e52a-4490-8bb6-8df24143468b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:21.701717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-121376ca-e52a-4490-8bb6-8df24143468b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:21.702163 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-121376ca-e52a-4490-8bb6-8df24143468b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:21.702579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-121376ca-e52a-4490-8bb6-8df24143468b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:21.845777 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-121376ca-e52a-4490-8bb6-8df24143468b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:21.854116 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-e99c6e48-3ccc-4493-9ac1-797417fb609b req-21a5b8b7-1db3-4e99-b078-68e696f1db98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3200a8b9-6447-41fb-8433-36b0283813ee", "name": "network-vif-plugged", "status": "completed", "tag": "54331d2d-aa76-4594-90ce-8cefce821aa5"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:21.854940 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-121376ca-e52a-4490-8bb6-8df24143468b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1365 microversion: 2.1 time: 0.165738 Oct 14 03:11:21.856146 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 280/555] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:21 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:21.878397 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-e99c6e48-3ccc-4493-9ac1-797417fb609b req-21a5b8b7-1db3-4e99-b078-68e696f1db98 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:21.879043 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-e99c6e48-3ccc-4493-9ac1-797417fb609b req-21a5b8b7-1db3-4e99-b078-68e696f1db98 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:21.879455 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-e99c6e48-3ccc-4493-9ac1-797417fb609b req-21a5b8b7-1db3-4e99-b078-68e696f1db98 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:21.890589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-e99c6e48-3ccc-4493-9ac1-797417fb609b req-21a5b8b7-1db3-4e99-b078-68e696f1db98 service nova] Creating event network-vif-plugged:54331d2d-aa76-4594-90ce-8cefce821aa5 for instance 3200a8b9-6447-41fb-8433-36b0283813ee on hv-cinder-80152 Oct 14 03:11:21.895337 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-e99c6e48-3ccc-4493-9ac1-797417fb609b req-21a5b8b7-1db3-4e99-b078-68e696f1db98 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046085 Oct 14 03:11:21.895925 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 276/556] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:11:22.035203 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-950be9b8-569b-4e76-b212-c6575d245ef3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:22.035845 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-950be9b8-569b-4e76-b212-c6575d245ef3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:22.041734 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-950be9b8-569b-4e76-b212-c6575d245ef3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:22.042212 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-950be9b8-569b-4e76-b212-c6575d245ef3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:22.042673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-950be9b8-569b-4e76-b212-c6575d245ef3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:22.043361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-950be9b8-569b-4e76-b212-c6575d245ef3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:22.043810 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-950be9b8-569b-4e76-b212-c6575d245ef3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:22.044232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-950be9b8-569b-4e76-b212-c6575d245ef3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:22.175059 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-950be9b8-569b-4e76-b212-c6575d245ef3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:22.183338 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-950be9b8-569b-4e76-b212-c6575d245ef3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.152513 Oct 14 03:11:22.183923 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 281/557] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:22 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:22.424126 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-2db87f2f-72c2-4334-868c-2f6386532ce6 req-65865fdb-d798-4821-ac83-6274a427ddf6 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "1d6e0af2-23bd-49ab-94eb-9ee6ab702d92", "create_info": {"type": "qcow2", "new_file": "volume-1d6e0af2-23bd-49ab-94eb-9ee6ab702d92.67099c62-2aaa-4f11-a229-7739309c38f4.vhdx", "snapshot_id": "67099c62-2aaa-4f11-a229-7739309c38f4"}}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:22.427506 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-2db87f2f-72c2-4334-868c-2f6386532ce6 req-65865fdb-d798-4821-ac83-6274a427ddf6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:22.428017 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-2db87f2f-72c2-4334-868c-2f6386532ce6 req-65865fdb-d798-4821-ac83-6274a427ddf6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:22.428475 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-2db87f2f-72c2-4334-868c-2f6386532ce6 req-65865fdb-d798-4821-ac83-6274a427ddf6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:22.436676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-2db87f2f-72c2-4334-868c-2f6386532ce6 req-65865fdb-d798-4821-ac83-6274a427ddf6 admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:22.437141 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-2db87f2f-72c2-4334-868c-2f6386532ce6 req-65865fdb-d798-4821-ac83-6274a427ddf6 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:22.437569 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-2db87f2f-72c2-4334-868c-2f6386532ce6 req-65865fdb-d798-4821-ac83-6274a427ddf6 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:22.451136 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-2db87f2f-72c2-4334-868c-2f6386532ce6 req-65865fdb-d798-4821-ac83-6274a427ddf6 admin admin] 10.222.0.44 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.076031 Oct 14 03:11:22.451731 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 277/558] 10.222.0.44 () {64 vars in 1326 bytes} [Fri Oct 14 03:11:22 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:11:22.878417 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3e5780d7-f624-444f-981a-f9fe2af5ee60 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:22.879023 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3e5780d7-f624-444f-981a-f9fe2af5ee60 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:22.885437 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3e5780d7-f624-444f-981a-f9fe2af5ee60 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:22.885928 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3e5780d7-f624-444f-981a-f9fe2af5ee60 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:22.886368 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3e5780d7-f624-444f-981a-f9fe2af5ee60 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:22.887068 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3e5780d7-f624-444f-981a-f9fe2af5ee60 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:22.887534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3e5780d7-f624-444f-981a-f9fe2af5ee60 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:22.887964 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3e5780d7-f624-444f-981a-f9fe2af5ee60 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:23.014164 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3e5780d7-f624-444f-981a-f9fe2af5ee60 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:23.022030 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3e5780d7-f624-444f-981a-f9fe2af5ee60 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1365 microversion: 2.1 time: 0.148097 Oct 14 03:11:23.022602 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 282/559] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:22 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:23.210493 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b0531b2b-4153-40a9-8c5d-a52836534a6f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:23.210493 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b0531b2b-4153-40a9-8c5d-a52836534a6f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:23.214638 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b0531b2b-4153-40a9-8c5d-a52836534a6f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:23.215124 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b0531b2b-4153-40a9-8c5d-a52836534a6f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:23.215567 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b0531b2b-4153-40a9-8c5d-a52836534a6f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:23.216261 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b0531b2b-4153-40a9-8c5d-a52836534a6f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:23.216746 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b0531b2b-4153-40a9-8c5d-a52836534a6f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:23.217179 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b0531b2b-4153-40a9-8c5d-a52836534a6f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:23.349624 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b0531b2b-4153-40a9-8c5d-a52836534a6f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:23.357715 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b0531b2b-4153-40a9-8c5d-a52836534a6f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.154999 Oct 14 03:11:23.358320 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 278/560] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:23 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:24.044625 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a6c4d35a-5add-44df-b011-2f2fa43e4c1d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:24.045235 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a6c4d35a-5add-44df-b011-2f2fa43e4c1d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:24.051558 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a6c4d35a-5add-44df-b011-2f2fa43e4c1d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:24.052033 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a6c4d35a-5add-44df-b011-2f2fa43e4c1d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:24.052489 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a6c4d35a-5add-44df-b011-2f2fa43e4c1d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:24.053180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a6c4d35a-5add-44df-b011-2f2fa43e4c1d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:24.053631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a6c4d35a-5add-44df-b011-2f2fa43e4c1d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:24.054055 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a6c4d35a-5add-44df-b011-2f2fa43e4c1d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:24.179860 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a6c4d35a-5add-44df-b011-2f2fa43e4c1d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:24.187609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a6c4d35a-5add-44df-b011-2f2fa43e4c1d tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1365 microversion: 2.1 time: 0.146828 Oct 14 03:11:24.188177 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 283/561] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:24 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:24.386623 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6c563d29-2da4-4131-bc8b-a5fa4229909b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:24.386623 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6c563d29-2da4-4131-bc8b-a5fa4229909b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:24.391516 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c563d29-2da4-4131-bc8b-a5fa4229909b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:24.391996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c563d29-2da4-4131-bc8b-a5fa4229909b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:24.392461 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c563d29-2da4-4131-bc8b-a5fa4229909b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:24.393153 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c563d29-2da4-4131-bc8b-a5fa4229909b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:24.394253 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c563d29-2da4-4131-bc8b-a5fa4229909b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:24.394677 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c563d29-2da4-4131-bc8b-a5fa4229909b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:24.735241 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6c563d29-2da4-4131-bc8b-a5fa4229909b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:24.743924 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6c563d29-2da4-4131-bc8b-a5fa4229909b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.364573 Oct 14 03:11:24.744605 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 279/562] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:24 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:25.210572 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-af590eea-ed8f-423d-9f16-05dc438a7efd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:25.211203 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-af590eea-ed8f-423d-9f16-05dc438a7efd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:25.217912 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af590eea-ed8f-423d-9f16-05dc438a7efd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:25.218390 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af590eea-ed8f-423d-9f16-05dc438a7efd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:25.218826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af590eea-ed8f-423d-9f16-05dc438a7efd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:25.219517 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af590eea-ed8f-423d-9f16-05dc438a7efd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:25.219973 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af590eea-ed8f-423d-9f16-05dc438a7efd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:25.220412 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-af590eea-ed8f-423d-9f16-05dc438a7efd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:25.347804 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-af590eea-ed8f-423d-9f16-05dc438a7efd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:25.355646 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-af590eea-ed8f-423d-9f16-05dc438a7efd tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1555 microversion: 2.1 time: 0.148983 Oct 14 03:11:25.356217 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 284/563] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:25 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:25.380852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2d8b2f00-c8e7-4b8e-91a5-a1f6eaee3a81 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:25.381330 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2d8b2f00-c8e7-4b8e-91a5-a1f6eaee3a81 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:25.387853 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d8b2f00-c8e7-4b8e-91a5-a1f6eaee3a81 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:25.388669 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d8b2f00-c8e7-4b8e-91a5-a1f6eaee3a81 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:25.388784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d8b2f00-c8e7-4b8e-91a5-a1f6eaee3a81 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:25.389460 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d8b2f00-c8e7-4b8e-91a5-a1f6eaee3a81 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:25.389912 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d8b2f00-c8e7-4b8e-91a5-a1f6eaee3a81 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:25.390333 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d8b2f00-c8e7-4b8e-91a5-a1f6eaee3a81 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:25.469775 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2d8b2f00-c8e7-4b8e-91a5-a1f6eaee3a81 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092765 Oct 14 03:11:25.470382 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 280/564] 10.222.0.13 () {58 vars in 1275 bytes} [Fri Oct 14 03:11:25 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:25.767819 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3bdc67ed-d758-48ba-81b4-40a9a0c7406a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:25.768359 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3bdc67ed-d758-48ba-81b4-40a9a0c7406a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:25.774861 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3bdc67ed-d758-48ba-81b4-40a9a0c7406a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:25.775351 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3bdc67ed-d758-48ba-81b4-40a9a0c7406a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:25.782003 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3bdc67ed-d758-48ba-81b4-40a9a0c7406a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:25.782003 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3bdc67ed-d758-48ba-81b4-40a9a0c7406a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:25.782003 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3bdc67ed-d758-48ba-81b4-40a9a0c7406a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:25.782003 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3bdc67ed-d758-48ba-81b4-40a9a0c7406a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:26.005991 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3bdc67ed-d758-48ba-81b4-40a9a0c7406a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:26.014183 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3bdc67ed-d758-48ba-81b4-40a9a0c7406a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.250494 Oct 14 03:11:26.014752 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 285/565] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:25 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:26.513800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-68e49e49-df1f-4d02-99d9-62db0e05097e req-6228dc2b-2ac3-443e-b828-6e031bc3c138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3200a8b9-6447-41fb-8433-36b0283813ee", "tag": "54331d2d-aa76-4594-90ce-8cefce821aa5"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:26.523307 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-68e49e49-df1f-4d02-99d9-62db0e05097e req-6228dc2b-2ac3-443e-b828-6e031bc3c138 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:26.523869 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-68e49e49-df1f-4d02-99d9-62db0e05097e req-6228dc2b-2ac3-443e-b828-6e031bc3c138 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:26.524316 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-68e49e49-df1f-4d02-99d9-62db0e05097e req-6228dc2b-2ac3-443e-b828-6e031bc3c138 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:26.535783 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-68e49e49-df1f-4d02-99d9-62db0e05097e req-6228dc2b-2ac3-443e-b828-6e031bc3c138 service nova] Creating event network-changed:54331d2d-aa76-4594-90ce-8cefce821aa5 for instance 3200a8b9-6447-41fb-8433-36b0283813ee on hv-cinder-80152 Oct 14 03:11:26.540671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-68e49e49-df1f-4d02-99d9-62db0e05097e req-6228dc2b-2ac3-443e-b828-6e031bc3c138 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031023 Oct 14 03:11:26.541451 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 281/566] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:27.038491 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a8ad1ee7-b1df-47d6-97cd-f9161f4917fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:27.039774 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a8ad1ee7-b1df-47d6-97cd-f9161f4917fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:27.047358 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a8ad1ee7-b1df-47d6-97cd-f9161f4917fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:27.048113 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a8ad1ee7-b1df-47d6-97cd-f9161f4917fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:27.048648 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a8ad1ee7-b1df-47d6-97cd-f9161f4917fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:27.049621 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a8ad1ee7-b1df-47d6-97cd-f9161f4917fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:27.050286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a8ad1ee7-b1df-47d6-97cd-f9161f4917fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:27.050785 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a8ad1ee7-b1df-47d6-97cd-f9161f4917fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:27.185062 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a8ad1ee7-b1df-47d6-97cd-f9161f4917fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:27.196026 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a8ad1ee7-b1df-47d6-97cd-f9161f4917fe tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.162156 Oct 14 03:11:27.196662 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 286/567] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:27 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:27.877478 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-196b4bd4-9d95-4725-ae4f-a39b1e1e8867 req-3a6b96b5-9d55-4d5e-8127-bef103e7e7f7 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "1d6e0af2-23bd-49ab-94eb-9ee6ab702d92", "create_info": {"type": "qcow2", "new_file": "volume-1d6e0af2-23bd-49ab-94eb-9ee6ab702d92.0b70c3ee-8a07-4f20-aa9e-c86e8a4d7c34.vhdx", "snapshot_id": "0b70c3ee-8a07-4f20-aa9e-c86e8a4d7c34"}}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:27.881263 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-196b4bd4-9d95-4725-ae4f-a39b1e1e8867 req-3a6b96b5-9d55-4d5e-8127-bef103e7e7f7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:27.881830 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-196b4bd4-9d95-4725-ae4f-a39b1e1e8867 req-3a6b96b5-9d55-4d5e-8127-bef103e7e7f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:27.882357 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-196b4bd4-9d95-4725-ae4f-a39b1e1e8867 req-3a6b96b5-9d55-4d5e-8127-bef103e7e7f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:27.890855 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-196b4bd4-9d95-4725-ae4f-a39b1e1e8867 req-3a6b96b5-9d55-4d5e-8127-bef103e7e7f7 admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:27.891418 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-196b4bd4-9d95-4725-ae4f-a39b1e1e8867 req-3a6b96b5-9d55-4d5e-8127-bef103e7e7f7 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:27.891928 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-196b4bd4-9d95-4725-ae4f-a39b1e1e8867 req-3a6b96b5-9d55-4d5e-8127-bef103e7e7f7 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:27.906116 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-196b4bd4-9d95-4725-ae4f-a39b1e1e8867 req-3a6b96b5-9d55-4d5e-8127-bef103e7e7f7 admin admin] 10.222.0.44 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.082631 Oct 14 03:11:27.913749 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 282/568] 10.222.0.44 () {64 vars in 1326 bytes} [Fri Oct 14 03:11:27 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:11:28.220053 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-158b5749-5e9a-4661-8eec-d351ea460935 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:28.220615 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-158b5749-5e9a-4661-8eec-d351ea460935 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:28.227386 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-158b5749-5e9a-4661-8eec-d351ea460935 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:28.227869 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-158b5749-5e9a-4661-8eec-d351ea460935 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:28.228303 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-158b5749-5e9a-4661-8eec-d351ea460935 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:28.229010 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-158b5749-5e9a-4661-8eec-d351ea460935 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:28.229460 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-158b5749-5e9a-4661-8eec-d351ea460935 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:28.229881 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-158b5749-5e9a-4661-8eec-d351ea460935 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:28.360931 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-158b5749-5e9a-4661-8eec-d351ea460935 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:28.369384 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-158b5749-5e9a-4661-8eec-d351ea460935 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.153123 Oct 14 03:11:28.369978 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 287/569] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:28 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:29.397694 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-1338ccde-8640-45c6-ad3c-11449eae071b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:29.398335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-1338ccde-8640-45c6-ad3c-11449eae071b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:29.404635 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1338ccde-8640-45c6-ad3c-11449eae071b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:29.405125 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1338ccde-8640-45c6-ad3c-11449eae071b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:29.405568 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1338ccde-8640-45c6-ad3c-11449eae071b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:29.406260 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1338ccde-8640-45c6-ad3c-11449eae071b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:29.406717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1338ccde-8640-45c6-ad3c-11449eae071b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:29.407145 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1338ccde-8640-45c6-ad3c-11449eae071b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:29.533587 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1338ccde-8640-45c6-ad3c-11449eae071b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:29.542230 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-1338ccde-8640-45c6-ad3c-11449eae071b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1734 microversion: 2.1 time: 0.149518 Oct 14 03:11:29.542805 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 283/570] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:29 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:30.565632 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e26aadf9-a67e-4590-8a5d-1cd2b957c8a7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:30.566234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e26aadf9-a67e-4590-8a5d-1cd2b957c8a7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:30.572771 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e26aadf9-a67e-4590-8a5d-1cd2b957c8a7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:30.573272 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e26aadf9-a67e-4590-8a5d-1cd2b957c8a7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:30.573703 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e26aadf9-a67e-4590-8a5d-1cd2b957c8a7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:30.574385 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e26aadf9-a67e-4590-8a5d-1cd2b957c8a7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:30.574832 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e26aadf9-a67e-4590-8a5d-1cd2b957c8a7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:30.575281 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e26aadf9-a67e-4590-8a5d-1cd2b957c8a7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:30.702182 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-e26aadf9-a67e-4590-8a5d-1cd2b957c8a7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:30.710908 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e26aadf9-a67e-4590-8a5d-1cd2b957c8a7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1714 microversion: 2.1 time: 0.149074 Oct 14 03:11:30.711472 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 288/571] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:30 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1714 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:30.821413 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9178c8b1-4d34-4b49-a52f-049ba855e0ea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:30.821913 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9178c8b1-4d34-4b49-a52f-049ba855e0ea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:30.829384 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9178c8b1-4d34-4b49-a52f-049ba855e0ea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:30.829908 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9178c8b1-4d34-4b49-a52f-049ba855e0ea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:30.830342 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9178c8b1-4d34-4b49-a52f-049ba855e0ea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:30.831043 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9178c8b1-4d34-4b49-a52f-049ba855e0ea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:30.831499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9178c8b1-4d34-4b49-a52f-049ba855e0ea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:30.831960 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9178c8b1-4d34-4b49-a52f-049ba855e0ea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:30.855874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=100 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:30.917835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-9178c8b1-4d34-4b49-a52f-049ba855e0ea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] HTTP exception thrown: Cannot 'detach_volume' instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 while it is in vm_state rescued Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9178c8b1-4d34-4b49-a52f-049ba855e0ea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Request method failure captured: Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: DELETE /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments/d161baf5-cb1b-4b1a-84fc-0437d6ba38b1 HTTP/1.1 Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKH4NxEPMl2MiNB1XCe-xt7krq1NrhiwWzh8PUcUNc7DPMToyK61BYEVmqnH8PcIjU4NdaDSCKUk9p7hizeKHSG12vRmixqmA6Av241GRS3ISj8jYf2FW8S0N5rYB7-2yQkL3Hn58t-PG07p68TryoPL80eVR0qFpm0wcS-Fmdl0QQ Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 61f89b8e68d14d3d96fa84ab1697fcea Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:11:30.919508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:11:30.920847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:11:30.920847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:11:30.920847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 61f89b8e68d14d3d96fa84ab1697fcea Oct 14 03:11:30.920847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:11:30.920847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-ServerRescueNegativeTestJSON-883339385-project Oct 14 03:11:30.920847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:11:30.920847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:11:30.920847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: dbf0723a0f3942d2b9b2554320878016 Oct 14 03:11:30.920847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-ServerRescueNegativeTestJSON-883339385-project Oct 14 03:11:30.920847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:11:30.920847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Cannot 'detach_volume' instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 while it is in vm_state rescued Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'server_id': 'a2ae6b50-1d01-420e-ab83-6c856e0b35d4', 'id': 'd161baf5-cb1b-4b1a-84fc-0437d6ba38b1'} Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:11:30.921621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 while it is in vm_state rescued Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 while it is in vm_state rescued Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:11:30.922969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9178c8b1-4d34-4b49-a52f-049ba855e0ea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Returning 409 to user: Cannot 'detach_volume' instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 while it is in vm_state rescued {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:11:30.923957 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9178c8b1-4d34-4b49-a52f-049ba855e0ea tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments/d161baf5-cb1b-4b1a-84fc-0437d6ba38b1" status: 409 len: 152 microversion: 2.1 time: 0.103693 Oct 14 03:11:30.923957 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 284/572] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Oct 14 03:11:30 2022] DELETE /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments/d161baf5-cb1b-4b1a-84fc-0437d6ba38b1 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 14 03:11:30.929949 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ad2be936-f955-4a5b-869b-4f259d8e3374 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:30.930656 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ad2be936-f955-4a5b-869b-4f259d8e3374 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:30.936794 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ad2be936-f955-4a5b-869b-4f259d8e3374 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:30.937305 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ad2be936-f955-4a5b-869b-4f259d8e3374 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:30.937746 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ad2be936-f955-4a5b-869b-4f259d8e3374 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:30.938471 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ad2be936-f955-4a5b-869b-4f259d8e3374 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:30.938929 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ad2be936-f955-4a5b-869b-4f259d8e3374 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:30.939350 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ad2be936-f955-4a5b-869b-4f259d8e3374 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:31.145135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ad2be936-f955-4a5b-869b-4f259d8e3374 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "POST /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/action" status: 202 len: 0 microversion: 2.1 time: 0.218721 Oct 14 03:11:31.145947 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 289/573] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Oct 14 03:11:30 2022] POST /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:11:31.155027 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-4147ce0a-2516-40c3-87c9-df31340ae5b0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:31.155638 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-4147ce0a-2516-40c3-87c9-df31340ae5b0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:31.161710 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4147ce0a-2516-40c3-87c9-df31340ae5b0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:31.162120 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4147ce0a-2516-40c3-87c9-df31340ae5b0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:31.162557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4147ce0a-2516-40c3-87c9-df31340ae5b0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:31.163246 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4147ce0a-2516-40c3-87c9-df31340ae5b0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:31.163704 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4147ce0a-2516-40c3-87c9-df31340ae5b0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:31.164129 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4147ce0a-2516-40c3-87c9-df31340ae5b0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:31.293352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4147ce0a-2516-40c3-87c9-df31340ae5b0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:31.301496 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-4147ce0a-2516-40c3-87c9-df31340ae5b0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1722 microversion: 2.1 time: 0.150667 Oct 14 03:11:31.302070 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 285/574] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:31 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:31.856208 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-d61315ce-33e3-40fe-82e5-3f4c6b1764b4 req-071cb717-43b7-4fff-8d8a-bc594d2bb1de admin admin] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:31.864857 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [req-d61315ce-33e3-40fe-82e5-3f4c6b1764b4 req-071cb717-43b7-4fff-8d8a-bc594d2bb1de admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e228678d-bf1f-4de4-9ba4-dd43fa30f246(cell1) {{(pid=119301) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 14 03:11:31.865340 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-d61315ce-33e3-40fe-82e5-3f4c6b1764b4 req-071cb717-43b7-4fff-8d8a-bc594d2bb1de admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:31.865790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-d61315ce-33e3-40fe-82e5-3f4c6b1764b4 req-071cb717-43b7-4fff-8d8a-bc594d2bb1de admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:31.866867 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-d61315ce-33e3-40fe-82e5-3f4c6b1764b4 req-071cb717-43b7-4fff-8d8a-bc594d2bb1de admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:31.905146 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-d61315ce-33e3-40fe-82e5-3f4c6b1764b4 req-071cb717-43b7-4fff-8d8a-bc594d2bb1de admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:31.905636 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-d61315ce-33e3-40fe-82e5-3f4c6b1764b4 req-071cb717-43b7-4fff-8d8a-bc594d2bb1de admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:31.906096 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-d61315ce-33e3-40fe-82e5-3f4c6b1764b4 req-071cb717-43b7-4fff-8d8a-bc594d2bb1de admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:31.929972 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-d61315ce-33e3-40fe-82e5-3f4c6b1764b4 req-071cb717-43b7-4fff-8d8a-bc594d2bb1de admin admin] 10.222.0.44 "DELETE /compute/v2.1/os-assisted-volume-snapshots/2cca88ab-a027-41bb-bd77-886bddf1b5cd?delete_info=%7B%22file_to_merge%22:%20%22volume-1d6e0af2-23bd-49ab-94eb-9ee6ab702d92.2cca88ab-a027-41bb-bd77-886bddf1b5cd.vhdx%22,%20%22volume_id%22:%20%221d6e0af2-23bd-49ab-94eb-9ee6ab702d92%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.134079 Oct 14 03:11:31.930565 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 290/575] 10.222.0.44 () {62 vars in 1800 bytes} [Fri Oct 14 03:11:31 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/2cca88ab-a027-41bb-bd77-886bddf1b5cd?delete_info=%7B%22file_to_merge%22:%20%22volume-1d6e0af2-23bd-49ab-94eb-9ee6ab702d92.2cca88ab-a027-41bb-bd77-886bddf1b5cd.vhdx%22,%20%22volume_id%22:%20%221d6e0af2-23bd-49ab-94eb-9ee6ab702d92%22%7D => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 03:11:32.325584 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-4df4513b-257a-4e23-910b-3e482e3771ef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:32.326206 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-4df4513b-257a-4e23-910b-3e482e3771ef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:32.332613 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4df4513b-257a-4e23-910b-3e482e3771ef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:32.333103 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4df4513b-257a-4e23-910b-3e482e3771ef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:32.333546 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4df4513b-257a-4e23-910b-3e482e3771ef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:32.334248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4df4513b-257a-4e23-910b-3e482e3771ef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:32.334713 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4df4513b-257a-4e23-910b-3e482e3771ef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:32.335794 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4df4513b-257a-4e23-910b-3e482e3771ef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:32.461557 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4df4513b-257a-4e23-910b-3e482e3771ef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:32.470047 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-4df4513b-257a-4e23-910b-3e482e3771ef tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1722 microversion: 2.1 time: 0.148419 Oct 14 03:11:32.470605 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 286/576] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:32 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:33.493347 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a7170e9b-553c-4316-8393-634dd6b7b3c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:33.494020 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a7170e9b-553c-4316-8393-634dd6b7b3c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:33.500174 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a7170e9b-553c-4316-8393-634dd6b7b3c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:33.500688 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a7170e9b-553c-4316-8393-634dd6b7b3c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:33.501124 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a7170e9b-553c-4316-8393-634dd6b7b3c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:33.501815 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a7170e9b-553c-4316-8393-634dd6b7b3c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:33.502263 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a7170e9b-553c-4316-8393-634dd6b7b3c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:33.502720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a7170e9b-553c-4316-8393-634dd6b7b3c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:33.632023 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a7170e9b-553c-4316-8393-634dd6b7b3c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:33.640356 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a7170e9b-553c-4316-8393-634dd6b7b3c3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1722 microversion: 2.1 time: 0.151911 Oct 14 03:11:33.640938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 291/577] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:33 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:34.663774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8667c8da-a1c3-4453-a60a-d2df2ff07804 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:34.664293 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8667c8da-a1c3-4453-a60a-d2df2ff07804 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:34.671221 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8667c8da-a1c3-4453-a60a-d2df2ff07804 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:34.671697 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8667c8da-a1c3-4453-a60a-d2df2ff07804 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:34.672132 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8667c8da-a1c3-4453-a60a-d2df2ff07804 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:34.672843 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8667c8da-a1c3-4453-a60a-d2df2ff07804 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:34.673298 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8667c8da-a1c3-4453-a60a-d2df2ff07804 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:34.673724 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8667c8da-a1c3-4453-a60a-d2df2ff07804 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:34.800809 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8667c8da-a1c3-4453-a60a-d2df2ff07804 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:34.809560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8667c8da-a1c3-4453-a60a-d2df2ff07804 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1722 microversion: 2.1 time: 0.149688 Oct 14 03:11:34.810122 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 287/578] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:34 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:35.832266 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d64f8f12-035f-413a-84ba-2727624c74f9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:35.832953 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d64f8f12-035f-413a-84ba-2727624c74f9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:35.839388 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d64f8f12-035f-413a-84ba-2727624c74f9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:35.839873 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d64f8f12-035f-413a-84ba-2727624c74f9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:35.840310 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d64f8f12-035f-413a-84ba-2727624c74f9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:35.841029 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d64f8f12-035f-413a-84ba-2727624c74f9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:35.841482 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d64f8f12-035f-413a-84ba-2727624c74f9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:35.841905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d64f8f12-035f-413a-84ba-2727624c74f9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:35.972622 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d64f8f12-035f-413a-84ba-2727624c74f9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:35.976129 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:35.981108 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d64f8f12-035f-413a-84ba-2727624c74f9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1722 microversion: 2.1 time: 0.152619 Oct 14 03:11:35.981673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 292/579] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:35 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:37.004236 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2a33d6f3-f1f0-4f82-bfd9-a15f78fbe27f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:37.004915 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2a33d6f3-f1f0-4f82-bfd9-a15f78fbe27f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:37.007322 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:37.012771 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2a33d6f3-f1f0-4f82-bfd9-a15f78fbe27f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:37.013355 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2a33d6f3-f1f0-4f82-bfd9-a15f78fbe27f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:37.013820 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2a33d6f3-f1f0-4f82-bfd9-a15f78fbe27f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:37.014608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2a33d6f3-f1f0-4f82-bfd9-a15f78fbe27f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:37.015065 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2a33d6f3-f1f0-4f82-bfd9-a15f78fbe27f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:37.015496 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2a33d6f3-f1f0-4f82-bfd9-a15f78fbe27f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:37.114634 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-0bdedc2d-dc95-4857-a8d8-b112ec65e464 req-9fb5592c-26cd-4c2a-a874-0fa754c52a4c admin admin] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:37.117981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-0bdedc2d-dc95-4857-a8d8-b112ec65e464 req-9fb5592c-26cd-4c2a-a874-0fa754c52a4c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:37.118467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-0bdedc2d-dc95-4857-a8d8-b112ec65e464 req-9fb5592c-26cd-4c2a-a874-0fa754c52a4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:37.118899 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-0bdedc2d-dc95-4857-a8d8-b112ec65e464 req-9fb5592c-26cd-4c2a-a874-0fa754c52a4c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:37.128212 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-0bdedc2d-dc95-4857-a8d8-b112ec65e464 req-9fb5592c-26cd-4c2a-a874-0fa754c52a4c admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:37.128717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-0bdedc2d-dc95-4857-a8d8-b112ec65e464 req-9fb5592c-26cd-4c2a-a874-0fa754c52a4c admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:37.129149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-0bdedc2d-dc95-4857-a8d8-b112ec65e464 req-9fb5592c-26cd-4c2a-a874-0fa754c52a4c admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:37.143247 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-0bdedc2d-dc95-4857-a8d8-b112ec65e464 req-9fb5592c-26cd-4c2a-a874-0fa754c52a4c admin admin] 10.222.0.44 "DELETE /compute/v2.1/os-assisted-volume-snapshots/0b70c3ee-8a07-4f20-aa9e-c86e8a4d7c34?delete_info=%7B%22file_to_merge%22:%20%22volume-1d6e0af2-23bd-49ab-94eb-9ee6ab702d92.0b70c3ee-8a07-4f20-aa9e-c86e8a4d7c34.vhdx%22,%20%22volume_id%22:%20%221d6e0af2-23bd-49ab-94eb-9ee6ab702d92%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.082367 Oct 14 03:11:37.143930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 293/580] 10.222.0.44 () {62 vars in 1800 bytes} [Fri Oct 14 03:11:37 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/0b70c3ee-8a07-4f20-aa9e-c86e8a4d7c34?delete_info=%7B%22file_to_merge%22:%20%22volume-1d6e0af2-23bd-49ab-94eb-9ee6ab702d92.0b70c3ee-8a07-4f20-aa9e-c86e8a4d7c34.vhdx%22,%20%22volume_id%22:%20%221d6e0af2-23bd-49ab-94eb-9ee6ab702d92%22%7D => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 03:11:37.153893 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2a33d6f3-f1f0-4f82-bfd9-a15f78fbe27f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:37.162092 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2a33d6f3-f1f0-4f82-bfd9-a15f78fbe27f tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1728 microversion: 2.1 time: 0.161553 Oct 14 03:11:37.162666 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 288/581] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:36 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:37.185598 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-477ad5b3-9c3d-4053-9f3a-e694a322fe2c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:37.186171 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-477ad5b3-9c3d-4053-9f3a-e694a322fe2c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:37.192374 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-477ad5b3-9c3d-4053-9f3a-e694a322fe2c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:37.192817 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-477ad5b3-9c3d-4053-9f3a-e694a322fe2c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:37.193256 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-477ad5b3-9c3d-4053-9f3a-e694a322fe2c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:37.194049 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-477ad5b3-9c3d-4053-9f3a-e694a322fe2c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:37.194539 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-477ad5b3-9c3d-4053-9f3a-e694a322fe2c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:37.194959 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-477ad5b3-9c3d-4053-9f3a-e694a322fe2c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:37.275081 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-477ad5b3-9c3d-4053-9f3a-e694a322fe2c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094415 Oct 14 03:11:37.276184 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 294/582] 10.222.0.13 () {58 vars in 1275 bytes} [Fri Oct 14 03:11:37 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:38.426075 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-64616ade-ca18-49a8-96c0-6251fbafbe31 req-fdf632bc-9825-42a9-b4ca-792573ce4bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ae6b50-1d01-420e-ab83-6c856e0b35d4", "tag": "f66ba8f5-3869-4069-a4dc-7c7a64eb44d9"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:38.431132 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=8 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:38.438274 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-64616ade-ca18-49a8-96c0-6251fbafbe31 req-fdf632bc-9825-42a9-b4ca-792573ce4bce service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:38.438758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-64616ade-ca18-49a8-96c0-6251fbafbe31 req-fdf632bc-9825-42a9-b4ca-792573ce4bce service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:38.444742 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-64616ade-ca18-49a8-96c0-6251fbafbe31 req-fdf632bc-9825-42a9-b4ca-792573ce4bce service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:38.451056 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-64616ade-ca18-49a8-96c0-6251fbafbe31 req-fdf632bc-9825-42a9-b4ca-792573ce4bce service nova] Creating event network-changed:f66ba8f5-3869-4069-a4dc-7c7a64eb44d9 for instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 on hv-cinder-80152 Oct 14 03:11:38.456290 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-64616ade-ca18-49a8-96c0-6251fbafbe31 req-fdf632bc-9825-42a9-b4ca-792573ce4bce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034378 Oct 14 03:11:38.456940 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 289/583] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:40.471984 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-1d9c1a40-f8e3-44ff-bc62-d6e83d020c2c req-92dc6550-a4f4-4c1d-82ff-750218a6eb66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ae6b50-1d01-420e-ab83-6c856e0b35d4", "tag": "f66ba8f5-3869-4069-a4dc-7c7a64eb44d9"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:40.481852 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-1d9c1a40-f8e3-44ff-bc62-d6e83d020c2c req-92dc6550-a4f4-4c1d-82ff-750218a6eb66 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:40.482322 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-1d9c1a40-f8e3-44ff-bc62-d6e83d020c2c req-92dc6550-a4f4-4c1d-82ff-750218a6eb66 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:40.482745 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-1d9c1a40-f8e3-44ff-bc62-d6e83d020c2c req-92dc6550-a4f4-4c1d-82ff-750218a6eb66 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:40.493632 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-1d9c1a40-f8e3-44ff-bc62-d6e83d020c2c req-92dc6550-a4f4-4c1d-82ff-750218a6eb66 service nova] Creating event network-changed:f66ba8f5-3869-4069-a4dc-7c7a64eb44d9 for instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 on hv-cinder-80152 Oct 14 03:11:40.498458 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-1d9c1a40-f8e3-44ff-bc62-d6e83d020c2c req-92dc6550-a4f4-4c1d-82ff-750218a6eb66 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031074 Oct 14 03:11:40.499011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 295/584] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:41.400669 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-a63d84a5-6db0-448c-82d5-5bb9ef03d192 req-fbf29f95-4da5-4a49-99d8-35870299d67c admin admin] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:41.403945 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-a63d84a5-6db0-448c-82d5-5bb9ef03d192 req-fbf29f95-4da5-4a49-99d8-35870299d67c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:41.404446 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-a63d84a5-6db0-448c-82d5-5bb9ef03d192 req-fbf29f95-4da5-4a49-99d8-35870299d67c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:41.404881 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-a63d84a5-6db0-448c-82d5-5bb9ef03d192 req-fbf29f95-4da5-4a49-99d8-35870299d67c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:41.412929 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-a63d84a5-6db0-448c-82d5-5bb9ef03d192 req-fbf29f95-4da5-4a49-99d8-35870299d67c admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:41.413394 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-a63d84a5-6db0-448c-82d5-5bb9ef03d192 req-fbf29f95-4da5-4a49-99d8-35870299d67c admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:41.413826 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-a63d84a5-6db0-448c-82d5-5bb9ef03d192 req-fbf29f95-4da5-4a49-99d8-35870299d67c admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:41.427325 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-a63d84a5-6db0-448c-82d5-5bb9ef03d192 req-fbf29f95-4da5-4a49-99d8-35870299d67c admin admin] 10.222.0.44 "DELETE /compute/v2.1/os-assisted-volume-snapshots/67099c62-2aaa-4f11-a229-7739309c38f4?delete_info=%7B%22file_to_merge%22:%20%22volume-1d6e0af2-23bd-49ab-94eb-9ee6ab702d92.67099c62-2aaa-4f11-a229-7739309c38f4.vhdx%22,%20%22volume_id%22:%20%221d6e0af2-23bd-49ab-94eb-9ee6ab702d92%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.077182 Oct 14 03:11:41.427979 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 290/585] 10.222.0.44 () {62 vars in 1800 bytes} [Fri Oct 14 03:11:41 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/67099c62-2aaa-4f11-a229-7739309c38f4?delete_info=%7B%22file_to_merge%22:%20%22volume-1d6e0af2-23bd-49ab-94eb-9ee6ab702d92.67099c62-2aaa-4f11-a229-7739309c38f4.vhdx%22,%20%22volume_id%22:%20%221d6e0af2-23bd-49ab-94eb-9ee6ab702d92%22%7D => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:11:44.629848 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-054082e9-8e8b-4b91-91a1-bbe07304e48c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:44.630464 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-054082e9-8e8b-4b91-91a1-bbe07304e48c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:44.636445 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-054082e9-8e8b-4b91-91a1-bbe07304e48c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:44.636925 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-054082e9-8e8b-4b91-91a1-bbe07304e48c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:44.637371 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-054082e9-8e8b-4b91-91a1-bbe07304e48c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:44.638041 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-054082e9-8e8b-4b91-91a1-bbe07304e48c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:44.638489 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-054082e9-8e8b-4b91-91a1-bbe07304e48c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:44.638916 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-054082e9-8e8b-4b91-91a1-bbe07304e48c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:44.667723 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-054082e9-8e8b-4b91-91a1-bbe07304e48c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/os-volume_attachments/f5760606-ff7c-4e5e-a45c-8c5ded8550c9" status: 200 len: 194 microversion: 2.20 time: 0.043377 Oct 14 03:11:44.668312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 296/586] 10.222.0.13 () {60 vars in 1454 bytes} [Fri Oct 14 03:11:44 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/os-volume_attachments/f5760606-ff7c-4e5e-a45c-8c5ded8550c9 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:11:44.738812 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ff5cc5eb-1ae6-4875-b9e3-940057672e30 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:44.739431 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ff5cc5eb-1ae6-4875-b9e3-940057672e30 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:44.745592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ff5cc5eb-1ae6-4875-b9e3-940057672e30 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:44.746080 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ff5cc5eb-1ae6-4875-b9e3-940057672e30 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:44.746523 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ff5cc5eb-1ae6-4875-b9e3-940057672e30 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:44.747225 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ff5cc5eb-1ae6-4875-b9e3-940057672e30 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:44.747684 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ff5cc5eb-1ae6-4875-b9e3-940057672e30 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:44.748115 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ff5cc5eb-1ae6-4875-b9e3-940057672e30 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:44.827308 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-ff5cc5eb-1ae6-4875-b9e3-940057672e30 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lazy-loading 'services' on Instance uuid 866d9750-81fa-4eba-a3b7-b1c1182ed24d {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:45.037798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ff5cc5eb-1ae6-4875-b9e3-940057672e30 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/os-volume_attachments/f5760606-ff7c-4e5e-a45c-8c5ded8550c9" status: 202 len: 0 microversion: 2.20 time: 0.304424 Oct 14 03:11:45.038387 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 291/587] 10.222.0.13 () {60 vars in 1457 bytes} [Fri Oct 14 03:11:44 2022] DELETE /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/os-volume_attachments/f5760606-ff7c-4e5e-a45c-8c5ded8550c9 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:11:45.046727 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-07b72d45-b5c7-405c-a2d8-a953351d20a4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:45.048848 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-07b72d45-b5c7-405c-a2d8-a953351d20a4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:45.054789 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-07b72d45-b5c7-405c-a2d8-a953351d20a4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:45.057829 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-07b72d45-b5c7-405c-a2d8-a953351d20a4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:45.057829 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-07b72d45-b5c7-405c-a2d8-a953351d20a4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:45.057829 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-07b72d45-b5c7-405c-a2d8-a953351d20a4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:45.057829 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-07b72d45-b5c7-405c-a2d8-a953351d20a4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:45.058242 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-07b72d45-b5c7-405c-a2d8-a953351d20a4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:45.088609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-07b72d45-b5c7-405c-a2d8-a953351d20a4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045774 Oct 14 03:11:45.089184 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 297/588] 10.222.0.13 () {60 vars in 1343 bytes} [Fri Oct 14 03:11:45 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:11:45.350336 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8a68d463-a010-4a88-8584-4c11eac73167 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:45.350929 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8a68d463-a010-4a88-8584-4c11eac73167 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:45.357175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a68d463-a010-4a88-8584-4c11eac73167 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:45.357662 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a68d463-a010-4a88-8584-4c11eac73167 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:45.358107 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a68d463-a010-4a88-8584-4c11eac73167 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:45.358808 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a68d463-a010-4a88-8584-4c11eac73167 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:45.359267 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a68d463-a010-4a88-8584-4c11eac73167 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:45.359702 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a68d463-a010-4a88-8584-4c11eac73167 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:45.438966 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-8a68d463-a010-4a88-8584-4c11eac73167 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lazy-loading 'services' on Instance uuid 0dba68e3-51ca-4ce2-9165-0d04c196138a {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:45.637917 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8a68d463-a010-4a88-8584-4c11eac73167 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a/os-volume_attachments/1d6e0af2-23bd-49ab-94eb-9ee6ab702d92" status: 202 len: 0 microversion: 2.1 time: 0.291968 Oct 14 03:11:45.638503 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 292/589] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Oct 14 03:11:45 2022] DELETE /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a/os-volume_attachments/1d6e0af2-23bd-49ab-94eb-9ee6ab702d92 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:11:46.102539 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1d4604af-5eaa-40ce-8a17-d3f6d5210345 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:46.104739 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1d4604af-5eaa-40ce-8a17-d3f6d5210345 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:46.112570 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d4604af-5eaa-40ce-8a17-d3f6d5210345 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:46.113058 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d4604af-5eaa-40ce-8a17-d3f6d5210345 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:46.113494 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d4604af-5eaa-40ce-8a17-d3f6d5210345 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:46.114190 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d4604af-5eaa-40ce-8a17-d3f6d5210345 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:46.114643 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d4604af-5eaa-40ce-8a17-d3f6d5210345 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:46.115066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d4604af-5eaa-40ce-8a17-d3f6d5210345 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:46.144168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1d4604af-5eaa-40ce-8a17-d3f6d5210345 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045585 Oct 14 03:11:46.144746 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 298/590] 10.222.0.13 () {60 vars in 1343 bytes} [Fri Oct 14 03:11:46 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:11:47.157840 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8a407220-4821-44ca-b239-40c547ac2e4d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:47.160175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8a407220-4821-44ca-b239-40c547ac2e4d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:47.166292 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a407220-4821-44ca-b239-40c547ac2e4d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.166772 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a407220-4821-44ca-b239-40c547ac2e4d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.167208 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a407220-4821-44ca-b239-40c547ac2e4d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.167892 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a407220-4821-44ca-b239-40c547ac2e4d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.168344 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a407220-4821-44ca-b239-40c547ac2e4d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.168793 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8a407220-4821-44ca-b239-40c547ac2e4d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.197080 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8a407220-4821-44ca-b239-40c547ac2e4d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044114 Oct 14 03:11:47.197680 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 293/591] 10.222.0.13 () {60 vars in 1343 bytes} [Fri Oct 14 03:11:47 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:47.259935 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-37a51838-69bd-4eb3-ba27-c6c5119c8633 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:47.260434 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-37a51838-69bd-4eb3-ba27-c6c5119c8633 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:47.262849 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=4 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:47.263518 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=46 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:47.268770 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37a51838-69bd-4eb3-ba27-c6c5119c8633 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.273847 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37a51838-69bd-4eb3-ba27-c6c5119c8633 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.273847 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37a51838-69bd-4eb3-ba27-c6c5119c8633 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.273847 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37a51838-69bd-4eb3-ba27-c6c5119c8633 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.273847 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37a51838-69bd-4eb3-ba27-c6c5119c8633 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.274215 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37a51838-69bd-4eb3-ba27-c6c5119c8633 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.296445 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-37a51838-69bd-4eb3-ba27-c6c5119c8633 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Going to try to terminate instance {{(pid=119301) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:11:47.559869 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-37a51838-69bd-4eb3-ba27-c6c5119c8633 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 204 len: 0 microversion: 2.20 time: 0.303348 Oct 14 03:11:47.560381 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 299/592] 10.222.0.13 () {60 vars in 1280 bytes} [Fri Oct 14 03:11:47 2022] DELETE /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 14 03:11:47.569257 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-7cb89b1b-ee8d-41a8-bb02-d5d9202e649f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:47.569899 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-7cb89b1b-ee8d-41a8-bb02-d5d9202e649f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:47.576016 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7cb89b1b-ee8d-41a8-bb02-d5d9202e649f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.580722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7cb89b1b-ee8d-41a8-bb02-d5d9202e649f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.580722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7cb89b1b-ee8d-41a8-bb02-d5d9202e649f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.580722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7cb89b1b-ee8d-41a8-bb02-d5d9202e649f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.580722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7cb89b1b-ee8d-41a8-bb02-d5d9202e649f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.581152 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7cb89b1b-ee8d-41a8-bb02-d5d9202e649f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.618706 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-88935262-0b7f-479e-adad-ddcbff631141 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:47.621118 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-88935262-0b7f-479e-adad-ddcbff631141 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:47.627592 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-88935262-0b7f-479e-adad-ddcbff631141 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.628074 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-88935262-0b7f-479e-adad-ddcbff631141 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.628531 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-88935262-0b7f-479e-adad-ddcbff631141 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.629246 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-88935262-0b7f-479e-adad-ddcbff631141 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.629694 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-88935262-0b7f-479e-adad-ddcbff631141 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.630111 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-88935262-0b7f-479e-adad-ddcbff631141 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.709545 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7cb89b1b-ee8d-41a8-bb02-d5d9202e649f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:47.718110 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7cb89b1b-ee8d-41a8-bb02-d5d9202e649f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:47.720096 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7cb89b1b-ee8d-41a8-bb02-d5d9202e649f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:47.721272 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-7cb89b1b-ee8d-41a8-bb02-d5d9202e649f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.155931 Oct 14 03:11:47.721834 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 294/593] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:47 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:47.823854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8afd89ad-3ebb-4ec0-a52e-87c8df1ea5af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:47.824449 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8afd89ad-3ebb-4ec0-a52e-87c8df1ea5af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:47.827013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-88935262-0b7f-479e-adad-ddcbff631141 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "POST /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/action" status: 202 len: 0 microversion: 2.1 time: 0.212542 Oct 14 03:11:47.827783 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 300/594] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Oct 14 03:11:47 2022] POST /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 03:11:47.830487 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8afd89ad-3ebb-4ec0-a52e-87c8df1ea5af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.832981 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8afd89ad-3ebb-4ec0-a52e-87c8df1ea5af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.832981 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8afd89ad-3ebb-4ec0-a52e-87c8df1ea5af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.832981 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8afd89ad-3ebb-4ec0-a52e-87c8df1ea5af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.832981 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8afd89ad-3ebb-4ec0-a52e-87c8df1ea5af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.833345 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8afd89ad-3ebb-4ec0-a52e-87c8df1ea5af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.836187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1739d4c9-8968-4c2d-85f7-7a6f990cbdc7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:47.836913 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1739d4c9-8968-4c2d-85f7-7a6f990cbdc7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:47.843190 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1739d4c9-8968-4c2d-85f7-7a6f990cbdc7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.843719 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1739d4c9-8968-4c2d-85f7-7a6f990cbdc7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.844729 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1739d4c9-8968-4c2d-85f7-7a6f990cbdc7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.845431 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1739d4c9-8968-4c2d-85f7-7a6f990cbdc7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.845885 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1739d4c9-8968-4c2d-85f7-7a6f990cbdc7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.846312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1739d4c9-8968-4c2d-85f7-7a6f990cbdc7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.861409 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8afd89ad-3ebb-4ec0-a52e-87c8df1ea5af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Going to try to terminate instance {{(pid=119302) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:11:47.994801 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1739d4c9-8968-4c2d-85f7-7a6f990cbdc7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:48.003441 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1739d4c9-8968-4c2d-85f7-7a6f990cbdc7 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1750 microversion: 2.1 time: 0.171311 Oct 14 03:11:48.004022 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 301/595] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:47 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:48.114136 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8afd89ad-3ebb-4ec0-a52e-87c8df1ea5af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 204 len: 0 microversion: 2.1 time: 0.293723 Oct 14 03:11:48.114643 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 295/596] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:11:47 2022] DELETE /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 03:11:48.122829 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d729ec9c-76bd-48b5-8f19-755e55950ac1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:48.123434 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d729ec9c-76bd-48b5-8f19-755e55950ac1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:48.129335 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d729ec9c-76bd-48b5-8f19-755e55950ac1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:48.131957 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d729ec9c-76bd-48b5-8f19-755e55950ac1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:48.131957 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d729ec9c-76bd-48b5-8f19-755e55950ac1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:48.131957 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d729ec9c-76bd-48b5-8f19-755e55950ac1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:48.131957 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d729ec9c-76bd-48b5-8f19-755e55950ac1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:48.132320 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d729ec9c-76bd-48b5-8f19-755e55950ac1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:48.263096 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d729ec9c-76bd-48b5-8f19-755e55950ac1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:48.271694 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d729ec9c-76bd-48b5-8f19-755e55950ac1 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1514 microversion: 2.1 time: 0.152752 Oct 14 03:11:48.272247 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 302/597] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:48 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:48.748228 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ee6e5991-ac2f-403f-963c-c60cbff4abbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:48.748979 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ee6e5991-ac2f-403f-963c-c60cbff4abbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:48.755847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ee6e5991-ac2f-403f-963c-c60cbff4abbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:48.756334 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ee6e5991-ac2f-403f-963c-c60cbff4abbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:48.756807 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ee6e5991-ac2f-403f-963c-c60cbff4abbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:48.757508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ee6e5991-ac2f-403f-963c-c60cbff4abbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:48.757973 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ee6e5991-ac2f-403f-963c-c60cbff4abbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:48.758408 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ee6e5991-ac2f-403f-963c-c60cbff4abbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:48.885514 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ee6e5991-ac2f-403f-963c-c60cbff4abbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:48.893586 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ee6e5991-ac2f-403f-963c-c60cbff4abbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:48.895165 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ee6e5991-ac2f-403f-963c-c60cbff4abbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:48.896327 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ee6e5991-ac2f-403f-963c-c60cbff4abbc tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.152371 Oct 14 03:11:48.896940 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 296/598] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:48 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:49.027089 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-49b298f9-ee40-4898-9b58-f2377d7aa3e0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:49.027624 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-49b298f9-ee40-4898-9b58-f2377d7aa3e0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:49.033572 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49b298f9-ee40-4898-9b58-f2377d7aa3e0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:49.034048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49b298f9-ee40-4898-9b58-f2377d7aa3e0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:49.034479 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49b298f9-ee40-4898-9b58-f2377d7aa3e0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:49.035163 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49b298f9-ee40-4898-9b58-f2377d7aa3e0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:49.035712 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49b298f9-ee40-4898-9b58-f2377d7aa3e0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:49.036138 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-49b298f9-ee40-4898-9b58-f2377d7aa3e0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:49.180676 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-49b298f9-ee40-4898-9b58-f2377d7aa3e0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:49.188851 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-49b298f9-ee40-4898-9b58-f2377d7aa3e0 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1750 microversion: 2.1 time: 0.165692 Oct 14 03:11:49.189412 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 303/599] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:49 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:49.295051 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6ab75902-ca34-4fa8-89d8-5631c8bd5a3a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:49.295584 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6ab75902-ca34-4fa8-89d8-5631c8bd5a3a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:49.302113 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6ab75902-ca34-4fa8-89d8-5631c8bd5a3a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:49.302593 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6ab75902-ca34-4fa8-89d8-5631c8bd5a3a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:49.303027 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6ab75902-ca34-4fa8-89d8-5631c8bd5a3a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:49.303707 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6ab75902-ca34-4fa8-89d8-5631c8bd5a3a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:49.304159 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6ab75902-ca34-4fa8-89d8-5631c8bd5a3a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:49.304613 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6ab75902-ca34-4fa8-89d8-5631c8bd5a3a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:49.439051 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6ab75902-ca34-4fa8-89d8-5631c8bd5a3a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:49.446826 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6ab75902-ca34-4fa8-89d8-5631c8bd5a3a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1514 microversion: 2.1 time: 0.155698 Oct 14 03:11:49.447405 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 297/600] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:49 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:49.923495 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d9389371-3301-4a85-8290-99fa30d5f4e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:49.924029 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d9389371-3301-4a85-8290-99fa30d5f4e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:49.930495 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9389371-3301-4a85-8290-99fa30d5f4e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:49.930972 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9389371-3301-4a85-8290-99fa30d5f4e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:49.931404 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9389371-3301-4a85-8290-99fa30d5f4e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:49.932088 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9389371-3301-4a85-8290-99fa30d5f4e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:49.932565 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9389371-3301-4a85-8290-99fa30d5f4e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:49.932991 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9389371-3301-4a85-8290-99fa30d5f4e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:50.060459 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d9389371-3301-4a85-8290-99fa30d5f4e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:50.069280 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d9389371-3301-4a85-8290-99fa30d5f4e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:50.070728 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d9389371-3301-4a85-8290-99fa30d5f4e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:50.071882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d9389371-3301-4a85-8290-99fa30d5f4e7 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.152370 Oct 14 03:11:50.072523 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 304/601] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:49 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:50.211887 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8f415f45-e9e1-4c84-b33e-11f6e99e6b74 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:50.212426 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8f415f45-e9e1-4c84-b33e-11f6e99e6b74 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:50.218699 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8f415f45-e9e1-4c84-b33e-11f6e99e6b74 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:50.219178 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8f415f45-e9e1-4c84-b33e-11f6e99e6b74 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:50.219614 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8f415f45-e9e1-4c84-b33e-11f6e99e6b74 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:50.220318 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8f415f45-e9e1-4c84-b33e-11f6e99e6b74 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:50.220803 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8f415f45-e9e1-4c84-b33e-11f6e99e6b74 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:50.221226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8f415f45-e9e1-4c84-b33e-11f6e99e6b74 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:50.361869 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8f415f45-e9e1-4c84-b33e-11f6e99e6b74 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:50.370012 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8f415f45-e9e1-4c84-b33e-11f6e99e6b74 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1750 microversion: 2.1 time: 0.162043 Oct 14 03:11:50.370592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 298/602] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:50 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:50.470815 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b6ec5dd4-2bbf-48f7-9e3a-6aef544c6351 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:50.471369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b6ec5dd4-2bbf-48f7-9e3a-6aef544c6351 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:50.477490 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b6ec5dd4-2bbf-48f7-9e3a-6aef544c6351 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:50.477965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b6ec5dd4-2bbf-48f7-9e3a-6aef544c6351 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:50.478391 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b6ec5dd4-2bbf-48f7-9e3a-6aef544c6351 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:50.479070 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b6ec5dd4-2bbf-48f7-9e3a-6aef544c6351 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:50.479515 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b6ec5dd4-2bbf-48f7-9e3a-6aef544c6351 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:50.479933 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b6ec5dd4-2bbf-48f7-9e3a-6aef544c6351 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:50.603498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b6ec5dd4-2bbf-48f7-9e3a-6aef544c6351 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:50.611230 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b6ec5dd4-2bbf-48f7-9e3a-6aef544c6351 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1514 microversion: 2.1 time: 0.144953 Oct 14 03:11:50.616357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 305/603] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:50 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:51.099495 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-bd9d2ce4-1365-4ed8-8d85-ae7245e6bfd3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:51.100155 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-bd9d2ce4-1365-4ed8-8d85-ae7245e6bfd3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:51.106263 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bd9d2ce4-1365-4ed8-8d85-ae7245e6bfd3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:51.106753 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bd9d2ce4-1365-4ed8-8d85-ae7245e6bfd3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:51.107224 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bd9d2ce4-1365-4ed8-8d85-ae7245e6bfd3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:51.107927 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bd9d2ce4-1365-4ed8-8d85-ae7245e6bfd3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:51.108403 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bd9d2ce4-1365-4ed8-8d85-ae7245e6bfd3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:51.108853 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bd9d2ce4-1365-4ed8-8d85-ae7245e6bfd3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:51.123821 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:51.236093 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-bd9d2ce4-1365-4ed8-8d85-ae7245e6bfd3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:51.244253 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-bd9d2ce4-1365-4ed8-8d85-ae7245e6bfd3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:51.245735 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-bd9d2ce4-1365-4ed8-8d85-ae7245e6bfd3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:51.246935 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-bd9d2ce4-1365-4ed8-8d85-ae7245e6bfd3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.152428 Oct 14 03:11:51.247490 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 299/604] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:51 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:51.393319 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c7b4924f-41af-4d44-b621-3463d3fb09f2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:51.393928 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c7b4924f-41af-4d44-b621-3463d3fb09f2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:51.400357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c7b4924f-41af-4d44-b621-3463d3fb09f2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:51.401147 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c7b4924f-41af-4d44-b621-3463d3fb09f2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:51.401586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c7b4924f-41af-4d44-b621-3463d3fb09f2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:51.402279 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c7b4924f-41af-4d44-b621-3463d3fb09f2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:51.402727 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c7b4924f-41af-4d44-b621-3463d3fb09f2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:51.403152 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c7b4924f-41af-4d44-b621-3463d3fb09f2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:51.543730 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c7b4924f-41af-4d44-b621-3463d3fb09f2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:51.553000 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c7b4924f-41af-4d44-b621-3463d3fb09f2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1750 microversion: 2.1 time: 0.163584 Oct 14 03:11:51.553562 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 306/605] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:51 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:51.638330 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f73d9ba6-f36a-47c5-9390-bfbc3873b71d tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:51.638965 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f73d9ba6-f36a-47c5-9390-bfbc3873b71d tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:51.640848 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=2 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:51.645597 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f73d9ba6-f36a-47c5-9390-bfbc3873b71d tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:51.646020 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f73d9ba6-f36a-47c5-9390-bfbc3873b71d tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:51.646453 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f73d9ba6-f36a-47c5-9390-bfbc3873b71d tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:51.647137 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f73d9ba6-f36a-47c5-9390-bfbc3873b71d tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:51.647594 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f73d9ba6-f36a-47c5-9390-bfbc3873b71d tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:51.648018 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f73d9ba6-f36a-47c5-9390-bfbc3873b71d tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:51.774900 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-f73d9ba6-f36a-47c5-9390-bfbc3873b71d tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:51.782445 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f73d9ba6-f36a-47c5-9390-bfbc3873b71d tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1514 microversion: 2.1 time: 0.148132 Oct 14 03:11:51.783011 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 300/606] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:51 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:52.272630 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3efc0906-0cf7-4ba0-a4e3-e31cd39600ee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:52.273233 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3efc0906-0cf7-4ba0-a4e3-e31cd39600ee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:52.279080 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3efc0906-0cf7-4ba0-a4e3-e31cd39600ee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:52.279559 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3efc0906-0cf7-4ba0-a4e3-e31cd39600ee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:52.279988 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3efc0906-0cf7-4ba0-a4e3-e31cd39600ee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:52.280697 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3efc0906-0cf7-4ba0-a4e3-e31cd39600ee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:52.281148 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3efc0906-0cf7-4ba0-a4e3-e31cd39600ee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:52.281570 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3efc0906-0cf7-4ba0-a4e3-e31cd39600ee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:52.409871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3efc0906-0cf7-4ba0-a4e3-e31cd39600ee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:52.417837 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3efc0906-0cf7-4ba0-a4e3-e31cd39600ee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:52.419273 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3efc0906-0cf7-4ba0-a4e3-e31cd39600ee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:52.420435 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3efc0906-0cf7-4ba0-a4e3-e31cd39600ee tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.152407 Oct 14 03:11:52.420985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 307/607] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:52 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:52.576095 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-26b86458-0032-420f-a2cf-e0171e0b852a tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:52.576770 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-26b86458-0032-420f-a2cf-e0171e0b852a tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:52.583108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-26b86458-0032-420f-a2cf-e0171e0b852a tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:52.583591 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-26b86458-0032-420f-a2cf-e0171e0b852a tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:52.584032 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-26b86458-0032-420f-a2cf-e0171e0b852a tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:52.584753 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-26b86458-0032-420f-a2cf-e0171e0b852a tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:52.585215 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-26b86458-0032-420f-a2cf-e0171e0b852a tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:52.585646 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-26b86458-0032-420f-a2cf-e0171e0b852a tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:52.728561 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-26b86458-0032-420f-a2cf-e0171e0b852a tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:52.737337 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-26b86458-0032-420f-a2cf-e0171e0b852a tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1750 microversion: 2.1 time: 0.164503 Oct 14 03:11:52.739882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 301/608] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:52 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:52.806505 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1d46f76c-918a-4616-baea-bb0df3cd0725 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:52.807057 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1d46f76c-918a-4616-baea-bb0df3cd0725 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:52.813067 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d46f76c-918a-4616-baea-bb0df3cd0725 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:52.813551 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d46f76c-918a-4616-baea-bb0df3cd0725 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:52.813990 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d46f76c-918a-4616-baea-bb0df3cd0725 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:52.814690 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d46f76c-918a-4616-baea-bb0df3cd0725 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:52.815149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d46f76c-918a-4616-baea-bb0df3cd0725 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:52.815580 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d46f76c-918a-4616-baea-bb0df3cd0725 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:52.833930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:52.945342 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1d46f76c-918a-4616-baea-bb0df3cd0725 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:52.953175 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1d46f76c-918a-4616-baea-bb0df3cd0725 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1514 microversion: 2.1 time: 0.150643 Oct 14 03:11:52.953740 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 308/609] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:52 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:53.446019 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-468925bb-1a03-4c08-b2df-5876b9c2e2c1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:53.446777 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-468925bb-1a03-4c08-b2df-5876b9c2e2c1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:53.452670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-468925bb-1a03-4c08-b2df-5876b9c2e2c1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:53.453146 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-468925bb-1a03-4c08-b2df-5876b9c2e2c1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:53.453582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-468925bb-1a03-4c08-b2df-5876b9c2e2c1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:53.454261 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-468925bb-1a03-4c08-b2df-5876b9c2e2c1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:53.454713 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-468925bb-1a03-4c08-b2df-5876b9c2e2c1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:53.455132 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-468925bb-1a03-4c08-b2df-5876b9c2e2c1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:53.582216 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-468925bb-1a03-4c08-b2df-5876b9c2e2c1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:53.590665 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-468925bb-1a03-4c08-b2df-5876b9c2e2c1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:53.592138 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-468925bb-1a03-4c08-b2df-5876b9c2e2c1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:53.593315 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-468925bb-1a03-4c08-b2df-5876b9c2e2c1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.151327 Oct 14 03:11:53.593866 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 302/610] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:53 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:53.761434 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-84c6aceb-7bad-48ee-a7f0-8c8fde4c7324 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:53.762024 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-84c6aceb-7bad-48ee-a7f0-8c8fde4c7324 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:53.769087 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-84c6aceb-7bad-48ee-a7f0-8c8fde4c7324 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:53.769567 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-84c6aceb-7bad-48ee-a7f0-8c8fde4c7324 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:53.770005 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-84c6aceb-7bad-48ee-a7f0-8c8fde4c7324 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:53.770703 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-84c6aceb-7bad-48ee-a7f0-8c8fde4c7324 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:53.771157 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-84c6aceb-7bad-48ee-a7f0-8c8fde4c7324 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:53.771588 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-84c6aceb-7bad-48ee-a7f0-8c8fde4c7324 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:53.909800 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-84c6aceb-7bad-48ee-a7f0-8c8fde4c7324 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:53.919116 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-84c6aceb-7bad-48ee-a7f0-8c8fde4c7324 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1750 microversion: 2.1 time: 0.161572 Oct 14 03:11:53.919682 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 309/611] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:53 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:53.976849 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6d5c9068-befc-4907-b663-442912d23b8a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:53.977491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6d5c9068-befc-4907-b663-442912d23b8a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:53.983323 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d5c9068-befc-4907-b663-442912d23b8a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:53.983812 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d5c9068-befc-4907-b663-442912d23b8a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:53.984260 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d5c9068-befc-4907-b663-442912d23b8a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:53.984985 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d5c9068-befc-4907-b663-442912d23b8a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:53.985446 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d5c9068-befc-4907-b663-442912d23b8a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:53.985875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d5c9068-befc-4907-b663-442912d23b8a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:54.118337 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6d5c9068-befc-4907-b663-442912d23b8a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:54.125978 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6d5c9068-befc-4907-b663-442912d23b8a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1514 microversion: 2.1 time: 0.153222 Oct 14 03:11:54.126548 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 303/612] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:53 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:54.619423 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b021ea70-d614-4889-b53a-fa90a01a93fb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:54.620034 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b021ea70-d614-4889-b53a-fa90a01a93fb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:54.625997 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b021ea70-d614-4889-b53a-fa90a01a93fb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:54.626479 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b021ea70-d614-4889-b53a-fa90a01a93fb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:54.626913 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b021ea70-d614-4889-b53a-fa90a01a93fb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:54.627599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b021ea70-d614-4889-b53a-fa90a01a93fb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:54.628071 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b021ea70-d614-4889-b53a-fa90a01a93fb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:54.628517 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b021ea70-d614-4889-b53a-fa90a01a93fb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:54.754020 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b021ea70-d614-4889-b53a-fa90a01a93fb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:54.761937 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b021ea70-d614-4889-b53a-fa90a01a93fb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:54.763375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b021ea70-d614-4889-b53a-fa90a01a93fb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:54.764559 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b021ea70-d614-4889-b53a-fa90a01a93fb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.148995 Oct 14 03:11:54.765111 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 310/613] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:54 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:54.942424 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-fbfcafd1-ac36-4251-a48b-b8ea93f4fd8d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:54.942953 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-fbfcafd1-ac36-4251-a48b-b8ea93f4fd8d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:54.949363 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fbfcafd1-ac36-4251-a48b-b8ea93f4fd8d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:54.949847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fbfcafd1-ac36-4251-a48b-b8ea93f4fd8d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:54.950288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fbfcafd1-ac36-4251-a48b-b8ea93f4fd8d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:54.950980 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fbfcafd1-ac36-4251-a48b-b8ea93f4fd8d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:54.951438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fbfcafd1-ac36-4251-a48b-b8ea93f4fd8d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:54.951866 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fbfcafd1-ac36-4251-a48b-b8ea93f4fd8d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:55.094094 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-fbfcafd1-ac36-4251-a48b-b8ea93f4fd8d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:55.103402 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-fbfcafd1-ac36-4251-a48b-b8ea93f4fd8d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1750 microversion: 2.1 time: 0.164929 Oct 14 03:11:55.103971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 304/614] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:54 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:55.149999 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b4a794cc-6de7-4000-9d76-624cf2533a45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:55.150615 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b4a794cc-6de7-4000-9d76-624cf2533a45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:55.157190 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b4a794cc-6de7-4000-9d76-624cf2533a45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:55.157852 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b4a794cc-6de7-4000-9d76-624cf2533a45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:55.158284 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b4a794cc-6de7-4000-9d76-624cf2533a45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:55.158965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b4a794cc-6de7-4000-9d76-624cf2533a45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:55.159974 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b4a794cc-6de7-4000-9d76-624cf2533a45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:55.160411 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b4a794cc-6de7-4000-9d76-624cf2533a45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:55.285334 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b4a794cc-6de7-4000-9d76-624cf2533a45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:55.292853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b4a794cc-6de7-4000-9d76-624cf2533a45 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1514 microversion: 2.1 time: 0.147153 Oct 14 03:11:55.293415 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 311/615] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:55 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:55.790071 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-1ec88ede-1614-47e8-b589-93533f235f44 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:55.790738 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-1ec88ede-1614-47e8-b589-93533f235f44 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:55.796594 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1ec88ede-1614-47e8-b589-93533f235f44 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:55.797078 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1ec88ede-1614-47e8-b589-93533f235f44 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:55.797509 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1ec88ede-1614-47e8-b589-93533f235f44 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:55.798194 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1ec88ede-1614-47e8-b589-93533f235f44 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:55.798642 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1ec88ede-1614-47e8-b589-93533f235f44 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:55.799062 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1ec88ede-1614-47e8-b589-93533f235f44 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:55.947369 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1ec88ede-1614-47e8-b589-93533f235f44 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:55.956120 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1ec88ede-1614-47e8-b589-93533f235f44 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:55.957642 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1ec88ede-1614-47e8-b589-93533f235f44 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:55.958822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-1ec88ede-1614-47e8-b589-93533f235f44 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1722 microversion: 2.20 time: 0.172762 Oct 14 03:11:55.959412 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 305/616] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:55 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:11:56.127279 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d744b6c9-f21a-4684-b7aa-5751b03f2f8e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:56.127890 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d744b6c9-f21a-4684-b7aa-5751b03f2f8e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:56.134057 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d744b6c9-f21a-4684-b7aa-5751b03f2f8e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:56.134536 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d744b6c9-f21a-4684-b7aa-5751b03f2f8e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:56.134966 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d744b6c9-f21a-4684-b7aa-5751b03f2f8e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:56.135772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d744b6c9-f21a-4684-b7aa-5751b03f2f8e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:56.136369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d744b6c9-f21a-4684-b7aa-5751b03f2f8e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:56.136812 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d744b6c9-f21a-4684-b7aa-5751b03f2f8e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:56.299973 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d744b6c9-f21a-4684-b7aa-5751b03f2f8e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:56.310671 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d744b6c9-f21a-4684-b7aa-5751b03f2f8e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1750 microversion: 2.1 time: 0.187855 Oct 14 03:11:56.311564 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 312/617] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:56 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1750 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:56.317645 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a1dab7b3-7158-4527-9ca6-34530e3af2a4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:56.318601 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-a1dab7b3-7158-4527-9ca6-34530e3af2a4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:56.327964 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1dab7b3-7158-4527-9ca6-34530e3af2a4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:56.327964 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1dab7b3-7158-4527-9ca6-34530e3af2a4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:56.327964 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1dab7b3-7158-4527-9ca6-34530e3af2a4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:56.327964 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1dab7b3-7158-4527-9ca6-34530e3af2a4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:56.328548 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1dab7b3-7158-4527-9ca6-34530e3af2a4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:56.328685 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1dab7b3-7158-4527-9ca6-34530e3af2a4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:56.473211 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a1dab7b3-7158-4527-9ca6-34530e3af2a4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:56.483521 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-a1dab7b3-7158-4527-9ca6-34530e3af2a4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1514 microversion: 2.1 time: 0.170609 Oct 14 03:11:56.484099 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 306/618] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:56 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:56.574276 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-de26cf6b-98db-4f3f-b6a4-5d1db2c5eb5c req-90b3181d-e8e7-4319-b3ff-9eac4ec1ab5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dba68e3-51ca-4ce2-9165-0d04c196138a", "name": "network-vif-deleted", "tag": "5e3c73a5-6040-4749-994f-19fa7172d3e2"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:56.584179 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-de26cf6b-98db-4f3f-b6a4-5d1db2c5eb5c req-90b3181d-e8e7-4319-b3ff-9eac4ec1ab5c service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:56.584692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-de26cf6b-98db-4f3f-b6a4-5d1db2c5eb5c req-90b3181d-e8e7-4319-b3ff-9eac4ec1ab5c service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:56.585133 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-de26cf6b-98db-4f3f-b6a4-5d1db2c5eb5c req-90b3181d-e8e7-4319-b3ff-9eac4ec1ab5c service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:56.595621 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-de26cf6b-98db-4f3f-b6a4-5d1db2c5eb5c req-90b3181d-e8e7-4319-b3ff-9eac4ec1ab5c service nova] Creating event network-vif-deleted:5e3c73a5-6040-4749-994f-19fa7172d3e2 for instance 0dba68e3-51ca-4ce2-9165-0d04c196138a on hv-cinder-80152 Oct 14 03:11:56.601123 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-de26cf6b-98db-4f3f-b6a4-5d1db2c5eb5c req-90b3181d-e8e7-4319-b3ff-9eac4ec1ab5c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030545 Oct 14 03:11:56.601960 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 313/619] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:56.985631 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a37408b6-776a-4d6e-8ebb-62c7dcb324cd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:56.986796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-a37408b6-776a-4d6e-8ebb-62c7dcb324cd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:57.001212 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a37408b6-776a-4d6e-8ebb-62c7dcb324cd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:57.001619 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a37408b6-776a-4d6e-8ebb-62c7dcb324cd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:57.002063 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a37408b6-776a-4d6e-8ebb-62c7dcb324cd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:57.002790 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a37408b6-776a-4d6e-8ebb-62c7dcb324cd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:57.003247 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a37408b6-776a-4d6e-8ebb-62c7dcb324cd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:57.004437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a37408b6-776a-4d6e-8ebb-62c7dcb324cd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:57.085992 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a37408b6-776a-4d6e-8ebb-62c7dcb324cd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:57.092253 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a37408b6-776a-4d6e-8ebb-62c7dcb324cd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:57.093834 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a37408b6-776a-4d6e-8ebb-62c7dcb324cd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:57.095213 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-a37408b6-776a-4d6e-8ebb-62c7dcb324cd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1655 microversion: 2.20 time: 0.114071 Oct 14 03:11:57.101583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 307/620] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:56 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1655 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:57.336454 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-47268116-7f5a-4041-ab62-48780f96738b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:57.337161 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-47268116-7f5a-4041-ab62-48780f96738b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:57.343617 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47268116-7f5a-4041-ab62-48780f96738b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:57.344180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47268116-7f5a-4041-ab62-48780f96738b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:57.344940 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47268116-7f5a-4041-ab62-48780f96738b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:57.345636 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47268116-7f5a-4041-ab62-48780f96738b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:57.346134 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47268116-7f5a-4041-ab62-48780f96738b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:57.346694 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47268116-7f5a-4041-ab62-48780f96738b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:57.499920 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-47268116-7f5a-4041-ab62-48780f96738b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:57.507503 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3fc9f494-7376-45b4-9c94-77cf067fc05f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:57.508200 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-3fc9f494-7376-45b4-9c94-77cf067fc05f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:57.509160 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-47268116-7f5a-4041-ab62-48780f96738b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1755 microversion: 2.1 time: 0.177741 Oct 14 03:11:57.509784 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 314/621] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:57 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:57.514911 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fc9f494-7376-45b4-9c94-77cf067fc05f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:57.515416 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fc9f494-7376-45b4-9c94-77cf067fc05f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:57.515863 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fc9f494-7376-45b4-9c94-77cf067fc05f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:57.516602 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fc9f494-7376-45b4-9c94-77cf067fc05f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:57.517065 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fc9f494-7376-45b4-9c94-77cf067fc05f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:57.517500 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fc9f494-7376-45b4-9c94-77cf067fc05f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:57.554828 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fc9f494-7376-45b4-9c94-77cf067fc05f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:57.555310 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fc9f494-7376-45b4-9c94-77cf067fc05f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:57.555748 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fc9f494-7376-45b4-9c94-77cf067fc05f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:57.556189 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-3fc9f494-7376-45b4-9c94-77cf067fc05f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lazy-loading 'fault' on Instance uuid 0dba68e3-51ca-4ce2-9165-0d04c196138a {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:57.596282 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3fc9f494-7376-45b4-9c94-77cf067fc05f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:57.604308 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-3fc9f494-7376-45b4-9c94-77cf067fc05f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 200 len: 1309 microversion: 2.1 time: 0.101228 Oct 14 03:11:57.604908 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 308/622] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:57 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:58.131795 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:58.132437 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:58.138439 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:58.138923 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:58.139364 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:58.140057 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:58.140562 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:58.140993 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:58.171419 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:58.171921 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:58.172341 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:58.172810 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lazy-loading 'fault' on Instance uuid 866d9750-81fa-4eba-a3b7-b1c1182ed24d {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:58.218343 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:58.227010 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:58.228731 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:58.230126 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-157e5853-0a68-4a57-a32d-56bb33a6e63a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 200 len: 1372 microversion: 2.20 time: 0.102961 Oct 14 03:11:58.230676 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 315/623] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:58 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:58.534059 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-953d8994-9f22-4793-8c74-27fbfa0041ee tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:58.534673 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-953d8994-9f22-4793-8c74-27fbfa0041ee tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:58.541764 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-953d8994-9f22-4793-8c74-27fbfa0041ee tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:58.542247 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-953d8994-9f22-4793-8c74-27fbfa0041ee tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:58.542688 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-953d8994-9f22-4793-8c74-27fbfa0041ee tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:58.543384 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-953d8994-9f22-4793-8c74-27fbfa0041ee tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:58.543840 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-953d8994-9f22-4793-8c74-27fbfa0041ee tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:58.544269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-953d8994-9f22-4793-8c74-27fbfa0041ee tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:58.615353 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-5e1966d3-d006-4d1f-b2b1-dec847943f7d req-6947ecc7-d61c-467e-9aab-4b9162ac32ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866d9750-81fa-4eba-a3b7-b1c1182ed24d", "name": "network-vif-deleted", "tag": "846e0443-12a3-4f37-a28b-a559f43fd6b4"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:58.625262 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-5e1966d3-d006-4d1f-b2b1-dec847943f7d req-6947ecc7-d61c-467e-9aab-4b9162ac32ea service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:58.625743 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-5e1966d3-d006-4d1f-b2b1-dec847943f7d req-6947ecc7-d61c-467e-9aab-4b9162ac32ea service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:58.626173 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-5e1966d3-d006-4d1f-b2b1-dec847943f7d req-6947ecc7-d61c-467e-9aab-4b9162ac32ea service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:58.637442 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-5e1966d3-d006-4d1f-b2b1-dec847943f7d req-6947ecc7-d61c-467e-9aab-4b9162ac32ea service nova] Creating event network-vif-deleted:846e0443-12a3-4f37-a28b-a559f43fd6b4 for instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d on hv-cinder-80152 Oct 14 03:11:58.642226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-5e1966d3-d006-4d1f-b2b1-dec847943f7d req-6947ecc7-d61c-467e-9aab-4b9162ac32ea service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030491 Oct 14 03:11:58.642821 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 316/624] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:58.648278 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-7c63c694-44ce-4931-b15c-7344af5ba06f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:58.649000 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-7c63c694-44ce-4931-b15c-7344af5ba06f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: 0dba68e3-51ca-4ce2-9165-0d04c196138a] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:58.655586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7c63c694-44ce-4931-b15c-7344af5ba06f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:58.656275 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7c63c694-44ce-4931-b15c-7344af5ba06f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:58.656932 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7c63c694-44ce-4931-b15c-7344af5ba06f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:58.657640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7c63c694-44ce-4931-b15c-7344af5ba06f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:58.658092 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7c63c694-44ce-4931-b15c-7344af5ba06f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:58.658516 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7c63c694-44ce-4931-b15c-7344af5ba06f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:58.673983 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-7c63c694-44ce-4931-b15c-7344af5ba06f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] HTTP exception thrown: Instance 0dba68e3-51ca-4ce2-9165-0d04c196138a could not be found. Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-7c63c694-44ce-4931-b15c-7344af5ba06f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Request method failure captured: Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a HTTP/1.1 Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNMV1oQqABeGlGrAyJA4MhiofscFZo9vOpZHFY76hOfflyMcIJChGaMl9Zb0_0Rn3jhlFVU1DtypTxVyk7CIj9J7gBAtvkoegQiyqaCMSAE29gCAvGdo1tAD0TRwX7enDJnU7jIv3YHmD430q9ZV0JMmrnpvKRgYVi58HbONe5bv4nc Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: faf6f8c0f3694f42a30232874a142685 Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1089667518 Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:11:58.675631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:11:58.677307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/faf6f8c0f3694f42a30232874a142685"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/faf6f8c0f3694f42a30232874a142685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/faf6f8c0f3694f42a30232874a142685"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_faf6f8c0f3694f42a30232874a142685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:11:58.677307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-VolumesSnapshotTestJSON-1089667518 Oct 14 03:11:58.677307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: faf6f8c0f3694f42a30232874a142685 Oct 14 03:11:58.677307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1089667518 Oct 14 03:11:58.677307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-VolumesSnapshotTestJSON-1089667518-project Oct 14 03:11:58.677307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:11:58.677307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:11:58.677307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 7175a36794194edba6b16366b0e12a0c Oct 14 03:11:58.677307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-VolumesSnapshotTestJSON-1089667518-project Oct 14 03:11:58.677307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:11:58.677307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance 0dba68e3-51ca-4ce2-9165-0d04c196138a could not be found. Oct 14 03:11:58.677307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '0dba68e3-51ca-4ce2-9165-0d04c196138a'} Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dba68e3-51ca-4ce2-9165-0d04c196138a could not be found. Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:11:58.678254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dba68e3-51ca-4ce2-9165-0d04c196138a could not be found. Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dba68e3-51ca-4ce2-9165-0d04c196138a could not be found. Oct 14 03:11:58.679474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:11:58.681484 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-7c63c694-44ce-4931-b15c-7344af5ba06f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Returning 404 to user: Instance 0dba68e3-51ca-4ce2-9165-0d04c196138a could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:11:58.681484 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-7c63c694-44ce-4931-b15c-7344af5ba06f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a" status: 404 len: 111 microversion: 2.1 time: 0.033196 Oct 14 03:11:58.681484 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 317/625] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:58 2022] GET /compute/v2.1/servers/0dba68e3-51ca-4ce2-9165-0d04c196138a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:11:58.701524 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-953d8994-9f22-4793-8c74-27fbfa0041ee tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:58.711320 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-953d8994-9f22-4793-8c74-27fbfa0041ee tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1755 microversion: 2.1 time: 0.181135 Oct 14 03:11:58.712534 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 309/626] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:58 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:59.255402 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9f001bde-fafc-43cb-b354-fe4dd10ac25d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:59.256646 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-9f001bde-fafc-43cb-b354-fe4dd10ac25d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:59.262556 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9f001bde-fafc-43cb-b354-fe4dd10ac25d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:59.263107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9f001bde-fafc-43cb-b354-fe4dd10ac25d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:59.263544 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9f001bde-fafc-43cb-b354-fe4dd10ac25d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:59.264236 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9f001bde-fafc-43cb-b354-fe4dd10ac25d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:59.264805 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9f001bde-fafc-43cb-b354-fe4dd10ac25d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:59.265236 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9f001bde-fafc-43cb-b354-fe4dd10ac25d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:59.278326 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-9f001bde-fafc-43cb-b354-fe4dd10ac25d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] HTTP exception thrown: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9f001bde-fafc-43cb-b354-fe4dd10ac25d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Request method failure captured: Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d HTTP/1.1 Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNKGCNYzUgY2W8ABGT17ZnZvUXr0wici_uC4FJd-MZKpAS6f8L6OQDWgZtxoVvYLblGrHLtin0R79yVHG9pQtD0u8dZkneMphiaS-s8IkENpBChNMMKCwbd4js56Y7LD3a0sEr57uhMse-JioqbN7ibvoxPFQEbd1Mnu09Yz453h-2Q Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: b28c1645ea1f4941ab2d016ad313ae6b Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:11:59.279844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:11:59.281467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:11:59.281467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:11:59.281467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: b28c1645ea1f4941ab2d016ad313ae6b Oct 14 03:11:59.281467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:11:59.281467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-AttachVolumeShelveTestJSON-786375232-project Oct 14 03:11:59.281467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:11:59.281467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:11:59.281467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 1201fb5f14154b048f5c55bd566e91b9 Oct 14 03:11:59.281467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-AttachVolumeShelveTestJSON-786375232-project Oct 14 03:11:59.281467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:11:59.281467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:11:59.281467 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '866d9750-81fa-4eba-a3b7-b1c1182ed24d'} Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:11:59.285853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:11:59.287257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:11:59.288295 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9f001bde-fafc-43cb-b354-fe4dd10ac25d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Returning 404 to user: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:11:59.288295 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9f001bde-fafc-43cb-b354-fe4dd10ac25d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 404 len: 111 microversion: 2.20 time: 0.029811 Oct 14 03:11:59.288295 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 318/627] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:59 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:11:59.290368 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0d7bdd81-85a1-4d24-8a25-ff2818c00cc5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '.version_select at 0x7fdcc7555c10>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:59.348084 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-0d7bdd81-85a1-4d24-8a25-ff2818c00cc5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273355437" status: 204 len: 0 microversion: 2.20 time: 0.061652 Oct 14 03:11:59.348738 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 310/628] 10.222.0.13 () {60 vars in 1262 bytes} [Fri Oct 14 03:11:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273355437 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 14 03:11:59.735368 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1711de49-5c01-49aa-946a-404a2a794164 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:59.735982 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1711de49-5c01-49aa-946a-404a2a794164 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:59.743290 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1711de49-5c01-49aa-946a-404a2a794164 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:59.743785 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1711de49-5c01-49aa-946a-404a2a794164 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:59.744223 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1711de49-5c01-49aa-946a-404a2a794164 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:59.744968 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1711de49-5c01-49aa-946a-404a2a794164 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:59.745422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1711de49-5c01-49aa-946a-404a2a794164 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:59.749415 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1711de49-5c01-49aa-946a-404a2a794164 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:59.899582 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1711de49-5c01-49aa-946a-404a2a794164 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:59.908166 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1711de49-5c01-49aa-946a-404a2a794164 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1755 microversion: 2.1 time: 0.176847 Oct 14 03:11:59.909796 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 319/629] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:59 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:00.269502 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-54a369dd-32c2-46ef-b145-72222079ba85 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Action: 'create', calling method: .version_select at 0x7fdcc74baca0>, body: {"keypair": {"name": "tempest-keypair-1233331511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3B4X8iaAYR+j+KvY4LtVlEHaQQLvoV4i6+iBsXuKWAHv6O2TZG3Bvpoj9s5o+1t3H2SS4ocj6e7XJwvRo20WIQZoNSp1PBgzokZM/1z732Iv2PcuZkbC+37TIaPUG+Bg=="}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:00.285950 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-54a369dd-32c2-46ef-b145-72222079ba85 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Getting quotas for project b28c1645ea1f4941ab2d016ad313ae6b. Resources: {'key_pairs'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:12:00.290293 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-54a369dd-32c2-46ef-b145-72222079ba85 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Getting quotas for user 1201fb5f14154b048f5c55bd566e91b9 and project b28c1645ea1f4941ab2d016ad313ae6b. Resources: {'key_pairs'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:12:00.366570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-54a369dd-32c2-46ef-b145-72222079ba85 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.101475 Oct 14 03:12:00.367182 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 311/630] 10.222.0.13 () {62 vars in 1200 bytes} [Fri Oct 14 03:12:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 103 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 14 03:12:00.577507 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c025e3ac-2816-4947-ad9c-0e9b429dddee tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:00.579678 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c025e3ac-2816-4947-ad9c-0e9b429dddee tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:00.586608 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c025e3ac-2816-4947-ad9c-0e9b429dddee tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:00.587065 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c025e3ac-2816-4947-ad9c-0e9b429dddee tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:00.587403 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c025e3ac-2816-4947-ad9c-0e9b429dddee tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:00.588103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c025e3ac-2816-4947-ad9c-0e9b429dddee tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:00.588591 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c025e3ac-2816-4947-ad9c-0e9b429dddee tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:00.589020 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c025e3ac-2816-4947-ad9c-0e9b429dddee tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:00.620279 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c025e3ac-2816-4947-ad9c-0e9b429dddee tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046509 Oct 14 03:12:00.625265 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 320/631] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:00 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:12:00.692767 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8166f9e1-b1a2-4b50-8812-c4fd4df506fd tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:00.693266 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8166f9e1-b1a2-4b50-8812-c4fd4df506fd tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:00.699884 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8166f9e1-b1a2-4b50-8812-c4fd4df506fd tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:00.700366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8166f9e1-b1a2-4b50-8812-c4fd4df506fd tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:00.700910 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8166f9e1-b1a2-4b50-8812-c4fd4df506fd tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:00.701604 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8166f9e1-b1a2-4b50-8812-c4fd4df506fd tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:00.702060 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8166f9e1-b1a2-4b50-8812-c4fd4df506fd tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:00.702577 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8166f9e1-b1a2-4b50-8812-c4fd4df506fd tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:00.727888 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8166f9e1-b1a2-4b50-8812-c4fd4df506fd tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Going to try to terminate instance {{(pid=119302) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:12:00.933242 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-19d76efa-ff33-4f45-a6b4-490917c9a777 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:00.933968 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-19d76efa-ff33-4f45-a6b4-490917c9a777 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:00.940974 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-19d76efa-ff33-4f45-a6b4-490917c9a777 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:00.941403 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-19d76efa-ff33-4f45-a6b4-490917c9a777 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:00.941848 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-19d76efa-ff33-4f45-a6b4-490917c9a777 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:00.942953 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-19d76efa-ff33-4f45-a6b4-490917c9a777 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:00.943074 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-19d76efa-ff33-4f45-a6b4-490917c9a777 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:00.943443 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-19d76efa-ff33-4f45-a6b4-490917c9a777 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:01.033775 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8166f9e1-b1a2-4b50-8812-c4fd4df506fd tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "DELETE /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 204 len: 0 microversion: 2.1 time: 0.345209 Oct 14 03:12:01.034594 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 312/632] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:12:00 2022] DELETE /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:12:01.043354 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d19e056f-8cda-4ca4-a37f-d2d68ef089cc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:01.044773 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d19e056f-8cda-4ca4-a37f-d2d68ef089cc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:01.050874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d19e056f-8cda-4ca4-a37f-d2d68ef089cc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:01.051792 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d19e056f-8cda-4ca4-a37f-d2d68ef089cc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:01.051982 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d19e056f-8cda-4ca4-a37f-d2d68ef089cc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:01.052711 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d19e056f-8cda-4ca4-a37f-d2d68ef089cc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:01.053675 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d19e056f-8cda-4ca4-a37f-d2d68ef089cc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:01.054387 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d19e056f-8cda-4ca4-a37f-d2d68ef089cc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:01.097393 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-19d76efa-ff33-4f45-a6b4-490917c9a777 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:01.105971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-19d76efa-ff33-4f45-a6b4-490917c9a777 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1755 microversion: 2.1 time: 0.176581 Oct 14 03:12:01.106553 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 321/633] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:00 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:01.194671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-d19e056f-8cda-4ca4-a37f-d2d68ef089cc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:01.202440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d19e056f-8cda-4ca4-a37f-d2d68ef089cc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1673 microversion: 2.1 time: 0.163371 Oct 14 03:12:01.203023 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 313/634] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:01 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:02.130139 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fe90f509-8159-4766-a996-0850513f27e6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:02.130970 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fe90f509-8159-4766-a996-0850513f27e6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:02.138113 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe90f509-8159-4766-a996-0850513f27e6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:02.138585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe90f509-8159-4766-a996-0850513f27e6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:02.139030 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe90f509-8159-4766-a996-0850513f27e6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:02.139843 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe90f509-8159-4766-a996-0850513f27e6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:02.140215 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe90f509-8159-4766-a996-0850513f27e6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:02.140665 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe90f509-8159-4766-a996-0850513f27e6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:02.225594 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e7bd10c9-cc3d-469b-86f0-460a9293c0f6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:02.229822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e7bd10c9-cc3d-469b-86f0-460a9293c0f6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:02.233258 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7bd10c9-cc3d-469b-86f0-460a9293c0f6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:02.233755 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7bd10c9-cc3d-469b-86f0-460a9293c0f6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:02.234196 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7bd10c9-cc3d-469b-86f0-460a9293c0f6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:02.234903 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7bd10c9-cc3d-469b-86f0-460a9293c0f6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:02.235489 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7bd10c9-cc3d-469b-86f0-460a9293c0f6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:02.235778 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7bd10c9-cc3d-469b-86f0-460a9293c0f6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:02.297178 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fe90f509-8159-4766-a996-0850513f27e6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:02.305974 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fe90f509-8159-4766-a996-0850513f27e6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1755 microversion: 2.1 time: 0.179907 Oct 14 03:12:02.306549 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 322/635] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:02 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:02.382693 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e7bd10c9-cc3d-469b-86f0-460a9293c0f6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:02.390364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e7bd10c9-cc3d-469b-86f0-460a9293c0f6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1673 microversion: 2.1 time: 0.168654 Oct 14 03:12:02.390944 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 314/636] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:02 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:02.525645 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1785105490", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13e2568f-f327-4e0c-a407-87e103f9e880"}], "security_groups": [{"name": "tempest-securitygroup--336277637"}], "key_name": "tempest-keypair-1233331511", "user_data": "}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:02.625674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.network.neutron [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] validate_networks() for [('13e2568f-f327-4e0c-a407-87e103f9e880', None, None, None, None, None)] {{(pid=119301) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:12:02.968584 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-703648526", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "networks": [{"uuid": "53fc415a-da17-4b6b-802b-8061304a5859"}]}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:02.990867 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Flavor limits 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:12:02.991933 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Image limits 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:12:02.992434 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Flavor pref 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:12:02.992852 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Image pref 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:12:02.993270 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:12:03.002149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:03.002632 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:03.003066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:03.003803 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:03.004255 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:03.004708 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:03.021135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Getting quotas for project b28c1645ea1f4941ab2d016ad313ae6b. Resources: {'instances', 'ram', 'cores'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:12:03.023483 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.network.neutron [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] validate_networks() for [('53fc415a-da17-4b6b-802b-8061304a5859', None, None, None, None, None)] {{(pid=119302) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:12:03.025580 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Getting quotas for user 1201fb5f14154b048f5c55bd566e91b9 and project b28c1645ea1f4941ab2d016ad313ae6b. Resources: {'instances', 'ram', 'cores'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:12:03.036666 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Going to run 1 instances... {{(pid=119301) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:12:03.039609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119301) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:12:03.169367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-434c4f26-516c-4419-a155-6100d9b96033 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.647996 Oct 14 03:12:03.172732 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 323/637] 10.222.0.13 () {62 vars in 1188 bytes} [Fri Oct 14 03:12:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 14 03:12:03.181610 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-91ad4b24-0792-4f75-ba47-438420c9723d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:03.182344 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-91ad4b24-0792-4f75-ba47-438420c9723d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:03.289453 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-91ad4b24-0792-4f75-ba47-438420c9723d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:03.292781 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-91ad4b24-0792-4f75-ba47-438420c9723d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:03.294564 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-91ad4b24-0792-4f75-ba47-438420c9723d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:03.295667 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-91ad4b24-0792-4f75-ba47-438420c9723d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1282 microversion: 2.20 time: 0.118340 Oct 14 03:12:03.296216 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 324/638] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:03 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1282 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:12:03.330167 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f7e51db5-a790-4db6-a4c7-4c3c11610182 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:03.330872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f7e51db5-a790-4db6-a4c7-4c3c11610182 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:03.338528 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f7e51db5-a790-4db6-a4c7-4c3c11610182 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:03.339017 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f7e51db5-a790-4db6-a4c7-4c3c11610182 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:03.339450 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f7e51db5-a790-4db6-a4c7-4c3c11610182 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:03.340154 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f7e51db5-a790-4db6-a4c7-4c3c11610182 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:03.340624 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f7e51db5-a790-4db6-a4c7-4c3c11610182 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:03.341047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f7e51db5-a790-4db6-a4c7-4c3c11610182 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:03.498311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Flavor limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:12:03.498890 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Image limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:12:03.499074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Flavor pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:12:03.499691 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Image pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:12:03.500311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:12:03.510256 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:03.510740 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:03.511173 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:03.512031 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:03.512680 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:03.513108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:03.530213 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f7e51db5-a790-4db6-a4c7-4c3c11610182 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:03.530382 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Getting quotas for project faf6f8c0f3694f42a30232874a142685. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:12:03.534324 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Getting quotas for user 7175a36794194edba6b16366b0e12a0c and project faf6f8c0f3694f42a30232874a142685. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:12:03.538750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f7e51db5-a790-4db6-a4c7-4c3c11610182 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1755 microversion: 2.1 time: 0.212224 Oct 14 03:12:03.548468 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 325/639] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:03 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1755 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:03.548468 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-6549e1c7-db2a-41dd-89e0-cb2855d9bf76 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:03.548468 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-6549e1c7-db2a-41dd-89e0-cb2855d9bf76 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:03.548852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Going to run 1 instances... {{(pid=119302) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:12:03.548852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:12:03.551418 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6549e1c7-db2a-41dd-89e0-cb2855d9bf76 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:03.552077 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6549e1c7-db2a-41dd-89e0-cb2855d9bf76 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:03.553368 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6549e1c7-db2a-41dd-89e0-cb2855d9bf76 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:03.554136 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6549e1c7-db2a-41dd-89e0-cb2855d9bf76 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:03.554625 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6549e1c7-db2a-41dd-89e0-cb2855d9bf76 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:03.555038 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6549e1c7-db2a-41dd-89e0-cb2855d9bf76 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:03.666257 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-28a51dbd-f7f2-4d3e-919d-61e6277eb61f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701447 Oct 14 03:12:03.667310 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 315/640] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:12:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 14 03:12:03.681147 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c0356052-9a5d-41e8-b8b5-f20a99dd40b0 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:03.681801 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c0356052-9a5d-41e8-b8b5-f20a99dd40b0 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:03.724268 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-6549e1c7-db2a-41dd-89e0-cb2855d9bf76 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:03.735220 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-6549e1c7-db2a-41dd-89e0-cb2855d9bf76 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1673 microversion: 2.1 time: 0.194091 Oct 14 03:12:03.735976 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 326/641] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:03 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:03.768738 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c0356052-9a5d-41e8-b8b5-f20a99dd40b0 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:03.776335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c0356052-9a5d-41e8-b8b5-f20a99dd40b0 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1218 microversion: 2.1 time: 0.101249 Oct 14 03:12:03.781093 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 316/642] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:03 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:04.321120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-58466318-4d5a-4885-b7e6-c88194818327 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:04.321738 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-58466318-4d5a-4885-b7e6-c88194818327 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:04.321962 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-991e6f7e-3235-4958-b861-42aef293aa6c req-0c1b8f43-7e69-409f-8b00-5201beee05eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62bd9290-c0f1-4e49-ac21-ffaad0578417", "name": "network-vif-deleted", "tag": "c4abf7d1-aa6f-4741-8265-17cd3e45f02e"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:04.331534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-58466318-4d5a-4885-b7e6-c88194818327 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.332034 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-58466318-4d5a-4885-b7e6-c88194818327 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.332354 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-991e6f7e-3235-4958-b861-42aef293aa6c req-0c1b8f43-7e69-409f-8b00-5201beee05eb service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.332523 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-58466318-4d5a-4885-b7e6-c88194818327 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.332876 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-991e6f7e-3235-4958-b861-42aef293aa6c req-0c1b8f43-7e69-409f-8b00-5201beee05eb service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.333316 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-991e6f7e-3235-4958-b861-42aef293aa6c req-0c1b8f43-7e69-409f-8b00-5201beee05eb service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.333610 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-58466318-4d5a-4885-b7e6-c88194818327 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.334076 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-58466318-4d5a-4885-b7e6-c88194818327 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.334501 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-58466318-4d5a-4885-b7e6-c88194818327 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.344988 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-991e6f7e-3235-4958-b861-42aef293aa6c req-0c1b8f43-7e69-409f-8b00-5201beee05eb service nova] Creating event network-vif-deleted:c4abf7d1-aa6f-4741-8265-17cd3e45f02e for instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 on hv-cinder-80152 Oct 14 03:12:04.349969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-991e6f7e-3235-4958-b861-42aef293aa6c req-0c1b8f43-7e69-409f-8b00-5201beee05eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031626 Oct 14 03:12:04.353991 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 317/643] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:04.443407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-58466318-4d5a-4885-b7e6-c88194818327 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:04.452993 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-58466318-4d5a-4885-b7e6-c88194818327 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:04.454987 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-58466318-4d5a-4885-b7e6-c88194818327 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:04.456296 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-58466318-4d5a-4885-b7e6-c88194818327 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1286 microversion: 2.20 time: 0.139596 Oct 14 03:12:04.459571 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 327/644] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:04 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:04.565399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6e12dbc8-051c-4c1c-a1a8-a3147bd86893 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:04.566123 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6e12dbc8-051c-4c1c-a1a8-a3147bd86893 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:04.568087 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:04.573790 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6e12dbc8-051c-4c1c-a1a8-a3147bd86893 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.574342 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6e12dbc8-051c-4c1c-a1a8-a3147bd86893 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.574789 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6e12dbc8-051c-4c1c-a1a8-a3147bd86893 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.575591 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6e12dbc8-051c-4c1c-a1a8-a3147bd86893 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.576041 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6e12dbc8-051c-4c1c-a1a8-a3147bd86893 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.576492 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6e12dbc8-051c-4c1c-a1a8-a3147bd86893 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.591708 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:04.734063 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6e12dbc8-051c-4c1c-a1a8-a3147bd86893 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:04.742421 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6e12dbc8-051c-4c1c-a1a8-a3147bd86893 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1755 microversion: 2.1 time: 0.181574 Oct 14 03:12:04.743002 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 318/645] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:04 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:04.760863 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-902a2a54-d72f-4862-b910-c1e4646623b2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:04.761481 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-902a2a54-d72f-4862-b910-c1e4646623b2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:04.784786 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-902a2a54-d72f-4862-b910-c1e4646623b2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.787819 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-902a2a54-d72f-4862-b910-c1e4646623b2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.787819 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-902a2a54-d72f-4862-b910-c1e4646623b2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.787819 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-902a2a54-d72f-4862-b910-c1e4646623b2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.787819 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-902a2a54-d72f-4862-b910-c1e4646623b2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.788174 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-902a2a54-d72f-4862-b910-c1e4646623b2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.799983 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-da5a0876-0790-409a-a297-73d523dc2cbf tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:04.801425 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-da5a0876-0790-409a-a297-73d523dc2cbf tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:04.809031 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-da5a0876-0790-409a-a297-73d523dc2cbf tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.809792 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-da5a0876-0790-409a-a297-73d523dc2cbf tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.814379 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-da5a0876-0790-409a-a297-73d523dc2cbf tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.814379 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-da5a0876-0790-409a-a297-73d523dc2cbf tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.814379 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-da5a0876-0790-409a-a297-73d523dc2cbf tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.814379 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-da5a0876-0790-409a-a297-73d523dc2cbf tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.829222 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-902a2a54-d72f-4862-b910-c1e4646623b2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.829710 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-902a2a54-d72f-4862-b910-c1e4646623b2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.830149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-902a2a54-d72f-4862-b910-c1e4646623b2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.830598 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-902a2a54-d72f-4862-b910-c1e4646623b2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lazy-loading 'fault' on Instance uuid 62bd9290-c0f1-4e49-ac21-ffaad0578417 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:04.912434 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-902a2a54-d72f-4862-b910-c1e4646623b2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:04.916882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=100 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:04.921804 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-902a2a54-d72f-4862-b910-c1e4646623b2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1326 microversion: 2.1 time: 0.164863 Oct 14 03:12:04.922870 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 328/646] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:04 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1326 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:04.941751 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-da5a0876-0790-409a-a297-73d523dc2cbf tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:04.951635 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-da5a0876-0790-409a-a297-73d523dc2cbf tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1222 microversion: 2.1 time: 0.156257 Oct 14 03:12:04.952244 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 319/647] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:04 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:05.484839 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-435a1941-4b6c-42ed-b6e0-3fa7365124b8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:05.484839 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-435a1941-4b6c-42ed-b6e0-3fa7365124b8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:05.490120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-435a1941-4b6c-42ed-b6e0-3fa7365124b8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.490809 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-435a1941-4b6c-42ed-b6e0-3fa7365124b8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.491286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-435a1941-4b6c-42ed-b6e0-3fa7365124b8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:05.492258 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-435a1941-4b6c-42ed-b6e0-3fa7365124b8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.492734 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-435a1941-4b6c-42ed-b6e0-3fa7365124b8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.493158 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-435a1941-4b6c-42ed-b6e0-3fa7365124b8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:05.560674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-435a1941-4b6c-42ed-b6e0-3fa7365124b8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:05.570274 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-435a1941-4b6c-42ed-b6e0-3fa7365124b8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:05.572030 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-435a1941-4b6c-42ed-b6e0-3fa7365124b8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:05.573380 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-435a1941-4b6c-42ed-b6e0-3fa7365124b8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1334 microversion: 2.20 time: 0.096453 Oct 14 03:12:05.573934 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 329/648] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:05 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1334 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:05.765622 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-5441bf6d-6147-435d-ac16-eab24c78222c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:05.766168 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-5441bf6d-6147-435d-ac16-eab24c78222c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:05.774328 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5441bf6d-6147-435d-ac16-eab24c78222c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.774803 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5441bf6d-6147-435d-ac16-eab24c78222c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.775247 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5441bf6d-6147-435d-ac16-eab24c78222c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:05.775947 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5441bf6d-6147-435d-ac16-eab24c78222c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.776411 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5441bf6d-6147-435d-ac16-eab24c78222c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.776884 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5441bf6d-6147-435d-ac16-eab24c78222c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:05.918270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5441bf6d-6147-435d-ac16-eab24c78222c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:05.926483 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-5441bf6d-6147-435d-ac16-eab24c78222c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1755 microversion: 2.1 time: 0.165157 Oct 14 03:12:05.927061 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 320/649] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:05 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:05.945024 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-beb4babe-c13c-4f02-a162-b7e845b1eed2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:05.946168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-beb4babe-c13c-4f02-a162-b7e845b1eed2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:05.952381 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb4babe-c13c-4f02-a162-b7e845b1eed2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.952898 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb4babe-c13c-4f02-a162-b7e845b1eed2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.953330 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb4babe-c13c-4f02-a162-b7e845b1eed2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:05.954015 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb4babe-c13c-4f02-a162-b7e845b1eed2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.954461 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb4babe-c13c-4f02-a162-b7e845b1eed2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.954903 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb4babe-c13c-4f02-a162-b7e845b1eed2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:05.983079 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-99f827a8-d7a2-415e-aeb7-19bba58a76d5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:05.983688 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-99f827a8-d7a2-415e-aeb7-19bba58a76d5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:05.985546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb4babe-c13c-4f02-a162-b7e845b1eed2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.986027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb4babe-c13c-4f02-a162-b7e845b1eed2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.986458 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-beb4babe-c13c-4f02-a162-b7e845b1eed2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:05.986898 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-beb4babe-c13c-4f02-a162-b7e845b1eed2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lazy-loading 'fault' on Instance uuid 62bd9290-c0f1-4e49-ac21-ffaad0578417 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:05.990101 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-99f827a8-d7a2-415e-aeb7-19bba58a76d5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.990592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-99f827a8-d7a2-415e-aeb7-19bba58a76d5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.991029 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-99f827a8-d7a2-415e-aeb7-19bba58a76d5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:05.991722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-99f827a8-d7a2-415e-aeb7-19bba58a76d5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.992803 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-99f827a8-d7a2-415e-aeb7-19bba58a76d5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.993451 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-99f827a8-d7a2-415e-aeb7-19bba58a76d5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:06.052413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-beb4babe-c13c-4f02-a162-b7e845b1eed2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:06.065269 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-beb4babe-c13c-4f02-a162-b7e845b1eed2 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 200 len: 1326 microversion: 2.1 time: 0.123955 Oct 14 03:12:06.076939 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 330/650] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:05 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 1326 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:06.084823 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-99f827a8-d7a2-415e-aeb7-19bba58a76d5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:06.093696 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-99f827a8-d7a2-415e-aeb7-19bba58a76d5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1214 microversion: 2.1 time: 0.114553 Oct 14 03:12:06.094388 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 321/651] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:05 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:06.599036 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1a304d92-121e-48e9-9922-527838d3f215 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:06.600301 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1a304d92-121e-48e9-9922-527838d3f215 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:06.607890 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1a304d92-121e-48e9-9922-527838d3f215 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:06.610112 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1a304d92-121e-48e9-9922-527838d3f215 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:06.610112 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1a304d92-121e-48e9-9922-527838d3f215 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:06.610112 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1a304d92-121e-48e9-9922-527838d3f215 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:06.610112 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1a304d92-121e-48e9-9922-527838d3f215 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:06.610566 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1a304d92-121e-48e9-9922-527838d3f215 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:06.743770 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1a304d92-121e-48e9-9922-527838d3f215 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:06.753260 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1a304d92-121e-48e9-9922-527838d3f215 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:06.754711 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1a304d92-121e-48e9-9922-527838d3f215 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:06.755855 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1a304d92-121e-48e9-9922-527838d3f215 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1407 microversion: 2.20 time: 0.160764 Oct 14 03:12:06.756439 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 331/652] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:06 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:06.950539 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-42f8102a-fcf2-4880-952c-9a4939fb20b2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:06.951095 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-42f8102a-fcf2-4880-952c-9a4939fb20b2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:06.957401 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-42f8102a-fcf2-4880-952c-9a4939fb20b2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:06.959407 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-42f8102a-fcf2-4880-952c-9a4939fb20b2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:06.959407 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-42f8102a-fcf2-4880-952c-9a4939fb20b2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:06.959407 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-42f8102a-fcf2-4880-952c-9a4939fb20b2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:06.959689 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-42f8102a-fcf2-4880-952c-9a4939fb20b2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:06.960013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-42f8102a-fcf2-4880-952c-9a4939fb20b2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:07.091163 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-bb4ec2e3-be62-4c88-bd44-a0e1ebaeb64a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:07.091690 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-bb4ec2e3-be62-4c88-bd44-a0e1ebaeb64a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:07.098923 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bb4ec2e3-be62-4c88-bd44-a0e1ebaeb64a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:07.099628 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bb4ec2e3-be62-4c88-bd44-a0e1ebaeb64a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:07.100062 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bb4ec2e3-be62-4c88-bd44-a0e1ebaeb64a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:07.101076 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bb4ec2e3-be62-4c88-bd44-a0e1ebaeb64a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:07.101716 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bb4ec2e3-be62-4c88-bd44-a0e1ebaeb64a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:07.102988 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bb4ec2e3-be62-4c88-bd44-a0e1ebaeb64a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:07.121437 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-bb4ec2e3-be62-4c88-bd44-a0e1ebaeb64a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] HTTP exception thrown: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-bb4ec2e3-be62-4c88-bd44-a0e1ebaeb64a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Request method failure captured: Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 HTTP/1.1 Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNKAP7HgYtc4-4-k7Pvw-tZEzRcER0oItatmvKceu0BM_7NqmPQSF9ui1_MKz4TXUi5Z_JuvPOc5RAU-6izpdrTjOyvsO3qVrKLzI_aKsakPLD0cbn0JT5PYSdN6NHyN4a_sJAcK6d8UQV7ALtSTJXAWkW3m-4b8hIBQotWtutxEyqM Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: ab840c288db6497bbd3a4b221cddf009 Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:12:07.123192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:12:07.124683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:12:07.124683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:12:07.124683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: ab840c288db6497bbd3a4b221cddf009 Oct 14 03:12:07.124683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:12:07.124683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-AttachVolumeTestJSON-2137333315-project Oct 14 03:12:07.124683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:12:07.124683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:12:07.124683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 2c196d842c4540b5800b4efa0ec4fc73 Oct 14 03:12:07.124683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-AttachVolumeTestJSON-2137333315-project Oct 14 03:12:07.124683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:12:07.124683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:12:07.124683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '62bd9290-c0f1-4e49-ac21-ffaad0578417'} Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:12:07.125405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:12:07.126692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:07.127735 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-bb4ec2e3-be62-4c88-bd44-a0e1ebaeb64a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Returning 404 to user: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:12:07.127735 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-bb4ec2e3-be62-4c88-bd44-a0e1ebaeb64a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 404 len: 111 microversion: 2.1 time: 0.038145 Oct 14 03:12:07.127735 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 332/653] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:07 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:12:07.127942 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-42f8102a-fcf2-4880-952c-9a4939fb20b2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:07.133831 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-2c297cdf-acf0-4971-be9f-412b33bac127 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:07.134422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-2c297cdf-acf0-4971-be9f-412b33bac127 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:07.140330 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2c297cdf-acf0-4971-be9f-412b33bac127 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:07.141021 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2c297cdf-acf0-4971-be9f-412b33bac127 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:07.141369 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-42f8102a-fcf2-4880-952c-9a4939fb20b2 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1755 microversion: 2.1 time: 0.195260 Oct 14 03:12:07.141848 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2c297cdf-acf0-4971-be9f-412b33bac127 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:07.143100 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2c297cdf-acf0-4971-be9f-412b33bac127 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:07.143923 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2c297cdf-acf0-4971-be9f-412b33bac127 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:07.144747 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2c297cdf-acf0-4971-be9f-412b33bac127 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:07.154661 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 322/654] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:06 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:07.159425 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b51305b1-22e7-4511-93f4-5894a62812fe tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '.version_select at 0x7fdcc74ba160>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:07.215363 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-2c297cdf-acf0-4971-be9f-412b33bac127 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:07.224794 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-2c297cdf-acf0-4971-be9f-412b33bac127 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1278 microversion: 2.1 time: 0.095180 Oct 14 03:12:07.225759 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 333/655] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:07 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1278 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:07.254942 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b51305b1-22e7-4511-93f4-5894a62812fe tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-192715436" status: 202 len: 0 microversion: 2.1 time: 0.099097 Oct 14 03:12:07.255522 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 323/656] 10.222.0.13 () {58 vars in 1218 bytes} [Fri Oct 14 03:12:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-192715436 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:12:07.781333 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-406ff6ad-9c45-4046-adaf-b4f652b6f8ca tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:07.782273 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-406ff6ad-9c45-4046-adaf-b4f652b6f8ca tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:07.787571 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:07.789682 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-406ff6ad-9c45-4046-adaf-b4f652b6f8ca tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:07.790906 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-406ff6ad-9c45-4046-adaf-b4f652b6f8ca tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:07.791443 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-406ff6ad-9c45-4046-adaf-b4f652b6f8ca tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:07.792251 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-406ff6ad-9c45-4046-adaf-b4f652b6f8ca tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:07.792828 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-406ff6ad-9c45-4046-adaf-b4f652b6f8ca tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:07.793417 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-406ff6ad-9c45-4046-adaf-b4f652b6f8ca tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:07.981765 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-406ff6ad-9c45-4046-adaf-b4f652b6f8ca tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:07.990377 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-406ff6ad-9c45-4046-adaf-b4f652b6f8ca tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:07.991868 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-406ff6ad-9c45-4046-adaf-b4f652b6f8ca tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:07.993053 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-406ff6ad-9c45-4046-adaf-b4f652b6f8ca tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1407 microversion: 2.20 time: 0.215815 Oct 14 03:12:07.993603 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 334/657] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:07 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:08.027367 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-419e89d6-026d-4ece-a395-2915561223a3 req-225cdf66-2c23-4d64-90b4-88b59aa2f4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7c6bac7-dcd5-4fd2-b81d-682898442716", "tag": "a0776357-4e9e-4296-84d0-654e4b00c042"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:08.038025 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-419e89d6-026d-4ece-a395-2915561223a3 req-225cdf66-2c23-4d64-90b4-88b59aa2f4fd service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:08.038640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-419e89d6-026d-4ece-a395-2915561223a3 req-225cdf66-2c23-4d64-90b4-88b59aa2f4fd service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:08.039177 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-419e89d6-026d-4ece-a395-2915561223a3 req-225cdf66-2c23-4d64-90b4-88b59aa2f4fd service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:08.049666 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-419e89d6-026d-4ece-a395-2915561223a3 req-225cdf66-2c23-4d64-90b4-88b59aa2f4fd service nova] Creating event network-changed:a0776357-4e9e-4296-84d0-654e4b00c042 for instance b7c6bac7-dcd5-4fd2-b81d-682898442716 on hv-cinder-80152 Oct 14 03:12:08.056371 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-419e89d6-026d-4ece-a395-2915561223a3 req-225cdf66-2c23-4d64-90b4-88b59aa2f4fd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033634 Oct 14 03:12:08.057382 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 324/658] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:08.155111 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-93418699-7f73-4fa5-8a3b-d1a52ddd7b55 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Action: 'create', calling method: .version_select at 0x7fdcc757d5e0>, body: {"keypair": {"name": "tempest-keypair-230829737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpL7Ee28qSVCvpSQqgqj96l4HtZMNA54S/61ie3hrS1PQdlFl7CYOUyVvpkWEmNujKdGEkSMjlPpB/N0L/We1/V2CB3SHqg8uRwswDOKgZxYXYErHpj4ViEHl1L14BlOg=="}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:08.167845 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-69c28dd9-f765-49e7-85d7-2a83946cf65f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:08.168751 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-69c28dd9-f765-49e7-85d7-2a83946cf65f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:08.172604 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-93418699-7f73-4fa5-8a3b-d1a52ddd7b55 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Getting quotas for project ab840c288db6497bbd3a4b221cddf009. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:12:08.174763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-69c28dd9-f765-49e7-85d7-2a83946cf65f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:08.175246 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-69c28dd9-f765-49e7-85d7-2a83946cf65f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:08.175741 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-69c28dd9-f765-49e7-85d7-2a83946cf65f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:08.176450 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-69c28dd9-f765-49e7-85d7-2a83946cf65f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:08.176912 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-69c28dd9-f765-49e7-85d7-2a83946cf65f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:08.179338 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-93418699-7f73-4fa5-8a3b-d1a52ddd7b55 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Getting quotas for user 2c196d842c4540b5800b4efa0ec4fc73 and project ab840c288db6497bbd3a4b221cddf009. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:12:08.179466 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-69c28dd9-f765-49e7-85d7-2a83946cf65f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:08.249062 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-93418699-7f73-4fa5-8a3b-d1a52ddd7b55 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097821 Oct 14 03:12:08.249664 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 335/659] 10.222.0.13 () {60 vars in 1159 bytes} [Fri Oct 14 03:12:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:08.254238 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-2f631585-f2de-48af-9067-20b1e69aae29 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:08.254853 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-2f631585-f2de-48af-9067-20b1e69aae29 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:08.262672 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f631585-f2de-48af-9067-20b1e69aae29 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:08.263332 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f631585-f2de-48af-9067-20b1e69aae29 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:08.263770 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f631585-f2de-48af-9067-20b1e69aae29 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:08.264647 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f631585-f2de-48af-9067-20b1e69aae29 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:08.265144 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f631585-f2de-48af-9067-20b1e69aae29 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:08.265685 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f631585-f2de-48af-9067-20b1e69aae29 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:08.378421 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-69c28dd9-f765-49e7-85d7-2a83946cf65f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:08.389563 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-69c28dd9-f765-49e7-85d7-2a83946cf65f tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1755 microversion: 2.1 time: 0.226688 Oct 14 03:12:08.390635 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 325/660] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:08 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1755 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:08.438057 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-2f631585-f2de-48af-9067-20b1e69aae29 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:08.446144 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-2f631585-f2de-48af-9067-20b1e69aae29 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1318 microversion: 2.1 time: 0.195358 Oct 14 03:12:08.447321 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 336/661] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:08 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:09.020069 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8c1299b8-f9d6-46af-ad94-27aff9f5dd5b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:09.021129 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8c1299b8-f9d6-46af-ad94-27aff9f5dd5b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:09.029218 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8c1299b8-f9d6-46af-ad94-27aff9f5dd5b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:09.029871 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8c1299b8-f9d6-46af-ad94-27aff9f5dd5b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:09.034727 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8c1299b8-f9d6-46af-ad94-27aff9f5dd5b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:09.034727 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8c1299b8-f9d6-46af-ad94-27aff9f5dd5b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:09.034727 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8c1299b8-f9d6-46af-ad94-27aff9f5dd5b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:09.034727 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8c1299b8-f9d6-46af-ad94-27aff9f5dd5b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:09.193373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8c1299b8-f9d6-46af-ad94-27aff9f5dd5b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:09.202627 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8c1299b8-f9d6-46af-ad94-27aff9f5dd5b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:09.204645 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8c1299b8-f9d6-46af-ad94-27aff9f5dd5b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:09.206004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8c1299b8-f9d6-46af-ad94-27aff9f5dd5b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1407 microversion: 2.20 time: 0.191430 Oct 14 03:12:09.215825 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 326/662] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:09 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:09.414090 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b3689c10-23c3-463e-a051-9c0f3771a471 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:09.414798 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b3689c10-23c3-463e-a051-9c0f3771a471 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:09.421460 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b3689c10-23c3-463e-a051-9c0f3771a471 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:09.421870 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b3689c10-23c3-463e-a051-9c0f3771a471 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:09.422309 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b3689c10-23c3-463e-a051-9c0f3771a471 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:09.423212 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b3689c10-23c3-463e-a051-9c0f3771a471 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:09.423671 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b3689c10-23c3-463e-a051-9c0f3771a471 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:09.424195 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b3689c10-23c3-463e-a051-9c0f3771a471 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:09.470386 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-78dc4f08-fce1-452f-87a4-31b0d92e960a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:09.471095 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-78dc4f08-fce1-452f-87a4-31b0d92e960a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:09.477464 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-78dc4f08-fce1-452f-87a4-31b0d92e960a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:09.478074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-78dc4f08-fce1-452f-87a4-31b0d92e960a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:09.478586 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-78dc4f08-fce1-452f-87a4-31b0d92e960a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:09.479457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-78dc4f08-fce1-452f-87a4-31b0d92e960a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:09.479991 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-78dc4f08-fce1-452f-87a4-31b0d92e960a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:09.480511 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-78dc4f08-fce1-452f-87a4-31b0d92e960a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:09.670341 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b3689c10-23c3-463e-a051-9c0f3771a471 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:09.679641 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b3689c10-23c3-463e-a051-9c0f3771a471 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1755 microversion: 2.1 time: 0.269743 Oct 14 03:12:09.680223 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 337/663] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:09 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1755 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:09.697728 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-78dc4f08-fce1-452f-87a4-31b0d92e960a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:09.705207 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-78dc4f08-fce1-452f-87a4-31b0d92e960a tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1318 microversion: 2.1 time: 0.238977 Oct 14 03:12:09.705783 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 327/664] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:09 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:10.076539 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-557421f8-cc8f-41eb-a530-f3ecc1d52d36 req-8c952806-0f57-4a29-8b96-5c55dfcb9423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec35719e-f7e5-4961-b289-277efae29da5", "tag": "0af7a28a-8080-43f0-91ce-95c4a14e9eb5"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:10.087237 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-557421f8-cc8f-41eb-a530-f3ecc1d52d36 req-8c952806-0f57-4a29-8b96-5c55dfcb9423 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.087752 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-557421f8-cc8f-41eb-a530-f3ecc1d52d36 req-8c952806-0f57-4a29-8b96-5c55dfcb9423 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.088185 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-557421f8-cc8f-41eb-a530-f3ecc1d52d36 req-8c952806-0f57-4a29-8b96-5c55dfcb9423 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.099749 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-557421f8-cc8f-41eb-a530-f3ecc1d52d36 req-8c952806-0f57-4a29-8b96-5c55dfcb9423 service nova] Creating event network-changed:0af7a28a-8080-43f0-91ce-95c4a14e9eb5 for instance ec35719e-f7e5-4961-b289-277efae29da5 on hv-cinder-80152 Oct 14 03:12:10.105630 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-557421f8-cc8f-41eb-a530-f3ecc1d52d36 req-8c952806-0f57-4a29-8b96-5c55dfcb9423 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035751 Oct 14 03:12:10.106239 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 338/665] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:10.232640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c0b97c9d-f496-4cc9-b944-bc89edc15b2c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:10.233262 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c0b97c9d-f496-4cc9-b944-bc89edc15b2c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:10.239958 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c0b97c9d-f496-4cc9-b944-bc89edc15b2c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.240501 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c0b97c9d-f496-4cc9-b944-bc89edc15b2c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.240943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c0b97c9d-f496-4cc9-b944-bc89edc15b2c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.241663 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c0b97c9d-f496-4cc9-b944-bc89edc15b2c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.242126 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c0b97c9d-f496-4cc9-b944-bc89edc15b2c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.242559 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c0b97c9d-f496-4cc9-b944-bc89edc15b2c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.530756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c0b97c9d-f496-4cc9-b944-bc89edc15b2c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:10.538816 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c0b97c9d-f496-4cc9-b944-bc89edc15b2c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:10.540298 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c0b97c9d-f496-4cc9-b944-bc89edc15b2c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:10.542049 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c0b97c9d-f496-4cc9-b944-bc89edc15b2c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1407 microversion: 2.20 time: 0.314310 Oct 14 03:12:10.542616 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 328/666] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:10 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:10.704013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ddb277cb-a9c6-4d41-8584-172d3fa6a0bd tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:10.705337 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ddb277cb-a9c6-4d41-8584-172d3fa6a0bd tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:10.711987 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ddb277cb-a9c6-4d41-8584-172d3fa6a0bd tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.712501 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ddb277cb-a9c6-4d41-8584-172d3fa6a0bd tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.713470 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ddb277cb-a9c6-4d41-8584-172d3fa6a0bd tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.714177 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ddb277cb-a9c6-4d41-8584-172d3fa6a0bd tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.714629 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ddb277cb-a9c6-4d41-8584-172d3fa6a0bd tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.715049 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ddb277cb-a9c6-4d41-8584-172d3fa6a0bd tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.729425 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d0b97493-97f8-4196-a4b4-fcd5ddc5e67e tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:10.730324 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d0b97493-97f8-4196-a4b4-fcd5ddc5e67e tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:10.737654 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d0b97493-97f8-4196-a4b4-fcd5ddc5e67e tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.738158 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d0b97493-97f8-4196-a4b4-fcd5ddc5e67e tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.738605 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d0b97493-97f8-4196-a4b4-fcd5ddc5e67e tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.739322 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d0b97493-97f8-4196-a4b4-fcd5ddc5e67e tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.739787 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d0b97493-97f8-4196-a4b4-fcd5ddc5e67e tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.740223 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d0b97493-97f8-4196-a4b4-fcd5ddc5e67e tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.990727 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-d0b97493-97f8-4196-a4b4-fcd5ddc5e67e tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:10.998989 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d0b97493-97f8-4196-a4b4-fcd5ddc5e67e tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1318 microversion: 2.1 time: 0.274184 Oct 14 03:12:11.003578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ddb277cb-a9c6-4d41-8584-172d3fa6a0bd tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:11.014788 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 329/667] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:10 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:11.019972 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ddb277cb-a9c6-4d41-8584-172d3fa6a0bd tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1755 microversion: 2.1 time: 0.320115 Oct 14 03:12:11.020695 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 339/668] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:10 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1755 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:11.435862 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-251508138", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a9392e4-7197-4d73-834c-66b02f0faa24"}], "security_groups": [{"name": "tempest-securitygroup--326294063"}], "key_name": "tempest-keypair-230829737", "user_data": "}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:11.539921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.network.neutron [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] validate_networks() for [('4a9392e4-7197-4d73-834c-66b02f0faa24', None, None, None, None, None)] {{(pid=119302) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:12:11.567082 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a3428327-df6a-4b2a-bd9c-8783b6dafc61 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:11.567693 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a3428327-df6a-4b2a-bd9c-8783b6dafc61 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:11.574480 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a3428327-df6a-4b2a-bd9c-8783b6dafc61 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:11.574963 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a3428327-df6a-4b2a-bd9c-8783b6dafc61 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:11.575407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a3428327-df6a-4b2a-bd9c-8783b6dafc61 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:11.576106 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a3428327-df6a-4b2a-bd9c-8783b6dafc61 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:11.576599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a3428327-df6a-4b2a-bd9c-8783b6dafc61 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:11.577026 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a3428327-df6a-4b2a-bd9c-8783b6dafc61 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:11.773202 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a3428327-df6a-4b2a-bd9c-8783b6dafc61 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:11.785183 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a3428327-df6a-4b2a-bd9c-8783b6dafc61 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:11.786678 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a3428327-df6a-4b2a-bd9c-8783b6dafc61 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:11.787804 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a3428327-df6a-4b2a-bd9c-8783b6dafc61 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1407 microversion: 2.20 time: 0.224698 Oct 14 03:12:11.788702 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 340/669] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:11 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:12:11.986580 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Flavor limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:12:11.987010 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Image limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:12:11.987492 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Flavor pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:12:11.987906 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Image pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:12:11.988656 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:12:11.998702 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:11.999188 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:11.999628 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:12.000365 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:12.000923 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:12.001350 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:12.018640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Getting quotas for project ab840c288db6497bbd3a4b221cddf009. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:12:12.023237 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Getting quotas for user 2c196d842c4540b5800b4efa0ec4fc73 and project ab840c288db6497bbd3a4b221cddf009. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:12:12.024712 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1b954d3e-ab3b-4ab1-b16e-578750d420f4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:12.025515 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1b954d3e-ab3b-4ab1-b16e-578750d420f4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:12.031838 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1b954d3e-ab3b-4ab1-b16e-578750d420f4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:12.032320 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1b954d3e-ab3b-4ab1-b16e-578750d420f4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:12.032789 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1b954d3e-ab3b-4ab1-b16e-578750d420f4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:12.033480 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1b954d3e-ab3b-4ab1-b16e-578750d420f4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:12.033936 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1b954d3e-ab3b-4ab1-b16e-578750d420f4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:12.034361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1b954d3e-ab3b-4ab1-b16e-578750d420f4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:12.035078 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Going to run 1 instances... {{(pid=119302) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:12:12.037447 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:12:12.166213 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1b954d3e-ab3b-4ab1-b16e-578750d420f4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:12.172009 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-bda05b2d-275e-471d-b442-520b853edd69 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.740965 Oct 14 03:12:12.172876 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 330/670] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:12:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:12:12.177383 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c21480d5-18b7-4048-9c4a-00cf12043296 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:12.177999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c21480d5-18b7-4048-9c4a-00cf12043296 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:12.182220 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1b954d3e-ab3b-4ab1-b16e-578750d420f4 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1318 microversion: 2.1 time: 0.161100 Oct 14 03:12:12.183050 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 341/671] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:12 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:12.188588 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8c98d9e6-66d6-4679-8cf9-0fdf5726c857 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:12.189218 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8c98d9e6-66d6-4679-8cf9-0fdf5726c857 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:12.198043 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c21480d5-18b7-4048-9c4a-00cf12043296 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:12.198545 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c21480d5-18b7-4048-9c4a-00cf12043296 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:12.199975 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c21480d5-18b7-4048-9c4a-00cf12043296 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:12.201101 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c21480d5-18b7-4048-9c4a-00cf12043296 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:12.201187 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c21480d5-18b7-4048-9c4a-00cf12043296 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:12.201631 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c21480d5-18b7-4048-9c4a-00cf12043296 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:12.256432 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8c98d9e6-66d6-4679-8cf9-0fdf5726c857 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:12.265064 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8c98d9e6-66d6-4679-8cf9-0fdf5726c857 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1236 microversion: 2.1 time: 0.080252 Oct 14 03:12:12.265877 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 342/672] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:12 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:12.356559 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c21480d5-18b7-4048-9c4a-00cf12043296 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:12.365063 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c21480d5-18b7-4048-9c4a-00cf12043296 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1755 microversion: 2.1 time: 0.191336 Oct 14 03:12:12.365715 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 331/673] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:12 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:12.814250 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-169c9e98-942d-40e0-bba6-8b00ab495372 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:12.814863 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-169c9e98-942d-40e0-bba6-8b00ab495372 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:12.822191 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-169c9e98-942d-40e0-bba6-8b00ab495372 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:12.822674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-169c9e98-942d-40e0-bba6-8b00ab495372 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:12.823755 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-169c9e98-942d-40e0-bba6-8b00ab495372 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:12.824473 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-169c9e98-942d-40e0-bba6-8b00ab495372 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:12.824925 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-169c9e98-942d-40e0-bba6-8b00ab495372 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:12.830804 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-169c9e98-942d-40e0-bba6-8b00ab495372 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:12.955315 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-169c9e98-942d-40e0-bba6-8b00ab495372 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:12.963503 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-169c9e98-942d-40e0-bba6-8b00ab495372 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:12.964974 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-169c9e98-942d-40e0-bba6-8b00ab495372 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:12.966082 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-169c9e98-942d-40e0-bba6-8b00ab495372 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1407 microversion: 2.20 time: 0.155695 Oct 14 03:12:12.966630 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 343/674] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:12 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:13.213803 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-1a993ae6-51e0-4335-ac4e-e46562612966 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:13.214414 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-1a993ae6-51e0-4335-ac4e-e46562612966 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:13.224352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1a993ae6-51e0-4335-ac4e-e46562612966 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:13.225169 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1a993ae6-51e0-4335-ac4e-e46562612966 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:13.225383 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1a993ae6-51e0-4335-ac4e-e46562612966 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:13.226028 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1a993ae6-51e0-4335-ac4e-e46562612966 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:13.226479 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1a993ae6-51e0-4335-ac4e-e46562612966 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:13.226910 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1a993ae6-51e0-4335-ac4e-e46562612966 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:13.230578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3d0f6596-ee88-4bdb-abe6-e227565964f7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:13.231069 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3d0f6596-ee88-4bdb-abe6-e227565964f7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:13.233335 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=2 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:13.238345 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3d0f6596-ee88-4bdb-abe6-e227565964f7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:13.238835 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3d0f6596-ee88-4bdb-abe6-e227565964f7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:13.239266 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3d0f6596-ee88-4bdb-abe6-e227565964f7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:13.239966 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3d0f6596-ee88-4bdb-abe6-e227565964f7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:13.240434 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3d0f6596-ee88-4bdb-abe6-e227565964f7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:13.240923 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3d0f6596-ee88-4bdb-abe6-e227565964f7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:13.265805 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3d0f6596-ee88-4bdb-abe6-e227565964f7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/ips" status: 200 len: 149 microversion: 2.1 time: 0.039480 Oct 14 03:12:13.266481 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 344/675] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Oct 14 03:12:13 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:13.288015 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-05a5967e-5af3-411a-b3f3-f488d87c609e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:13.288729 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-05a5967e-5af3-411a-b3f3-f488d87c609e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:13.298203 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05a5967e-5af3-411a-b3f3-f488d87c609e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:13.298692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05a5967e-5af3-411a-b3f3-f488d87c609e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:13.299257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05a5967e-5af3-411a-b3f3-f488d87c609e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:13.300102 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05a5967e-5af3-411a-b3f3-f488d87c609e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:13.300762 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05a5967e-5af3-411a-b3f3-f488d87c609e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:13.301185 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-05a5967e-5af3-411a-b3f3-f488d87c609e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:13.369373 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-05a5967e-5af3-411a-b3f3-f488d87c609e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:13.378521 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-05a5967e-5af3-411a-b3f3-f488d87c609e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1240 microversion: 2.1 time: 0.094272 Oct 14 03:12:13.379449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 345/676] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:13 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:13.387656 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fbf62757-1213-475b-82da-d53c15c4f173 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:13.388269 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fbf62757-1213-475b-82da-d53c15c4f173 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:13.394089 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fbf62757-1213-475b-82da-d53c15c4f173 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:13.394767 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fbf62757-1213-475b-82da-d53c15c4f173 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:13.395202 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fbf62757-1213-475b-82da-d53c15c4f173 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:13.395899 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fbf62757-1213-475b-82da-d53c15c4f173 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:13.396552 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fbf62757-1213-475b-82da-d53c15c4f173 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:13.397143 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fbf62757-1213-475b-82da-d53c15c4f173 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:13.397284 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1a993ae6-51e0-4335-ac4e-e46562612966 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:13.406053 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-1a993ae6-51e0-4335-ac4e-e46562612966 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1318 microversion: 2.1 time: 0.201523 Oct 14 03:12:13.406722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 332/677] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:13 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:13.546749 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fbf62757-1213-475b-82da-d53c15c4f173 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:13.555167 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fbf62757-1213-475b-82da-d53c15c4f173 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1755 microversion: 2.1 time: 0.171138 Oct 14 03:12:13.555779 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 346/678] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:13 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:13.992068 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9585f068-b680-4d62-bfbb-36ba7a3f3c18 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:13.993212 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9585f068-b680-4d62-bfbb-36ba7a3f3c18 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:14.000030 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9585f068-b680-4d62-bfbb-36ba7a3f3c18 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:14.000703 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9585f068-b680-4d62-bfbb-36ba7a3f3c18 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:14.001232 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9585f068-b680-4d62-bfbb-36ba7a3f3c18 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:14.002009 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9585f068-b680-4d62-bfbb-36ba7a3f3c18 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:14.002543 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9585f068-b680-4d62-bfbb-36ba7a3f3c18 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:14.003196 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9585f068-b680-4d62-bfbb-36ba7a3f3c18 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:14.142198 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9585f068-b680-4d62-bfbb-36ba7a3f3c18 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:14.151124 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9585f068-b680-4d62-bfbb-36ba7a3f3c18 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:14.153645 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9585f068-b680-4d62-bfbb-36ba7a3f3c18 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:14.154785 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9585f068-b680-4d62-bfbb-36ba7a3f3c18 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1407 microversion: 2.20 time: 0.167453 Oct 14 03:12:14.161233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 333/679] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:13 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:14.401902 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1ee905a6-3829-4a3d-9093-9e610904ebbc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:14.407215 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1ee905a6-3829-4a3d-9093-9e610904ebbc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:14.410283 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1ee905a6-3829-4a3d-9093-9e610904ebbc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:14.410772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1ee905a6-3829-4a3d-9093-9e610904ebbc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:14.411216 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1ee905a6-3829-4a3d-9093-9e610904ebbc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:14.411921 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1ee905a6-3829-4a3d-9093-9e610904ebbc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:14.412379 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1ee905a6-3829-4a3d-9093-9e610904ebbc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:14.413167 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1ee905a6-3829-4a3d-9093-9e610904ebbc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:14.433886 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ddf0daf8-f6e9-4813-9ff6-5e6f257bfa7b tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:14.437653 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ddf0daf8-f6e9-4813-9ff6-5e6f257bfa7b tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:14.442725 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ddf0daf8-f6e9-4813-9ff6-5e6f257bfa7b tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:14.443963 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ddf0daf8-f6e9-4813-9ff6-5e6f257bfa7b tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:14.450056 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ddf0daf8-f6e9-4813-9ff6-5e6f257bfa7b tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:14.451075 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ddf0daf8-f6e9-4813-9ff6-5e6f257bfa7b tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:14.451769 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ddf0daf8-f6e9-4813-9ff6-5e6f257bfa7b tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:14.452221 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ddf0daf8-f6e9-4813-9ff6-5e6f257bfa7b tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:14.486479 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1ee905a6-3829-4a3d-9093-9e610904ebbc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:14.494839 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1ee905a6-3829-4a3d-9093-9e610904ebbc tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1288 microversion: 2.1 time: 0.096726 Oct 14 03:12:14.496006 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 347/680] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:14 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:14.579374 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-48202795-2669-46ff-beee-cf8549f730a8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:14.579905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-48202795-2669-46ff-beee-cf8549f730a8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:14.585749 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-48202795-2669-46ff-beee-cf8549f730a8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:14.586235 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-48202795-2669-46ff-beee-cf8549f730a8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:14.586673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-48202795-2669-46ff-beee-cf8549f730a8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:14.587369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-48202795-2669-46ff-beee-cf8549f730a8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:14.587825 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-48202795-2669-46ff-beee-cf8549f730a8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:14.588015 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ddf0daf8-f6e9-4813-9ff6-5e6f257bfa7b tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:14.588246 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-48202795-2669-46ff-beee-cf8549f730a8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:14.595974 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ddf0daf8-f6e9-4813-9ff6-5e6f257bfa7b tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1318 microversion: 2.1 time: 0.170157 Oct 14 03:12:14.599647 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 334/681] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:14 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:14.730346 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-48202795-2669-46ff-beee-cf8549f730a8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:14.734055 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=100 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:14.738990 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-48202795-2669-46ff-beee-cf8549f730a8 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1758 microversion: 2.1 time: 0.163662 Oct 14 03:12:14.739553 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 348/682] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:14 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:15.001967 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-928861c8-c16a-4803-89f6-0faf103c1f2e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42aae591-c34c-47b8-ba6a-7ebc47fedd30"}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:15.004395 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-928861c8-c16a-4803-89f6-0faf103c1f2e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:15.010495 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-928861c8-c16a-4803-89f6-0faf103c1f2e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.010990 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-928861c8-c16a-4803-89f6-0faf103c1f2e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.011435 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-928861c8-c16a-4803-89f6-0faf103c1f2e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.012130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-928861c8-c16a-4803-89f6-0faf103c1f2e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.012621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-928861c8-c16a-4803-89f6-0faf103c1f2e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.013048 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-928861c8-c16a-4803-89f6-0faf103c1f2e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.181458 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f65d985f-a9f9-4cb2-acf7-277370544109 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:15.182081 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f65d985f-a9f9-4cb2-acf7-277370544109 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:15.189735 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f65d985f-a9f9-4cb2-acf7-277370544109 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.190294 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f65d985f-a9f9-4cb2-acf7-277370544109 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.190682 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f65d985f-a9f9-4cb2-acf7-277370544109 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.191648 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f65d985f-a9f9-4cb2-acf7-277370544109 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.192115 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f65d985f-a9f9-4cb2-acf7-277370544109 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.192579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f65d985f-a9f9-4cb2-acf7-277370544109 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.343562 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f65d985f-a9f9-4cb2-acf7-277370544109 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:15.352496 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f65d985f-a9f9-4cb2-acf7-277370544109 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:15.353958 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f65d985f-a9f9-4cb2-acf7-277370544109 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:15.355716 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f65d985f-a9f9-4cb2-acf7-277370544109 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1407 microversion: 2.20 time: 0.179754 Oct 14 03:12:15.362418 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 349/683] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:15 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:12:15.520997 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1d5d7805-38a9-434c-a990-c59fae7a7006 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:15.521666 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1d5d7805-38a9-434c-a990-c59fae7a7006 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:15.528691 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d5d7805-38a9-434c-a990-c59fae7a7006 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.529204 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d5d7805-38a9-434c-a990-c59fae7a7006 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.529833 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d5d7805-38a9-434c-a990-c59fae7a7006 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.530543 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d5d7805-38a9-434c-a990-c59fae7a7006 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.530999 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d5d7805-38a9-434c-a990-c59fae7a7006 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.531431 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1d5d7805-38a9-434c-a990-c59fae7a7006 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.597242 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1d5d7805-38a9-434c-a990-c59fae7a7006 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:15.606343 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1d5d7805-38a9-434c-a990-c59fae7a7006 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1294 microversion: 2.1 time: 0.089149 Oct 14 03:12:15.607303 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 350/684] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:15 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:15.619856 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b4d80602-a098-4b36-9ec2-2ad409aec495 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:15.620487 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b4d80602-a098-4b36-9ec2-2ad409aec495 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:15.626537 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b4d80602-a098-4b36-9ec2-2ad409aec495 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.627106 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b4d80602-a098-4b36-9ec2-2ad409aec495 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.627608 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b4d80602-a098-4b36-9ec2-2ad409aec495 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.628412 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b4d80602-a098-4b36-9ec2-2ad409aec495 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.628864 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b4d80602-a098-4b36-9ec2-2ad409aec495 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.629294 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b4d80602-a098-4b36-9ec2-2ad409aec495 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.746729 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-928861c8-c16a-4803-89f6-0faf103c1f2e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "POST /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.748072 Oct 14 03:12:15.748522 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 335/685] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Oct 14 03:12:14 2022] POST /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:15.780443 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b4d80602-a098-4b36-9ec2-2ad409aec495 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:15.788377 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b4d80602-a098-4b36-9ec2-2ad409aec495 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1318 microversion: 2.1 time: 0.172966 Oct 14 03:12:15.789010 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 351/686] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:15 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:16.380822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6f24203d-9831-46bb-85dc-2b1bc5a1eed6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:16.381943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6f24203d-9831-46bb-85dc-2b1bc5a1eed6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:16.388475 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6f24203d-9831-46bb-85dc-2b1bc5a1eed6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:16.388962 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6f24203d-9831-46bb-85dc-2b1bc5a1eed6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:16.389392 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6f24203d-9831-46bb-85dc-2b1bc5a1eed6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:16.390118 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6f24203d-9831-46bb-85dc-2b1bc5a1eed6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:16.390642 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6f24203d-9831-46bb-85dc-2b1bc5a1eed6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:16.391067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6f24203d-9831-46bb-85dc-2b1bc5a1eed6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:16.395304 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:16.523601 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6f24203d-9831-46bb-85dc-2b1bc5a1eed6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:16.532637 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6f24203d-9831-46bb-85dc-2b1bc5a1eed6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:16.534184 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6f24203d-9831-46bb-85dc-2b1bc5a1eed6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:16.535387 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6f24203d-9831-46bb-85dc-2b1bc5a1eed6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1407 microversion: 2.20 time: 0.159108 Oct 14 03:12:16.535955 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 336/687] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:16 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:16.629419 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c95319a1-de79-40f8-919e-fd164f28d448 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:16.630517 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c95319a1-de79-40f8-919e-fd164f28d448 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:16.636694 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c95319a1-de79-40f8-919e-fd164f28d448 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:16.637179 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c95319a1-de79-40f8-919e-fd164f28d448 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:16.637616 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c95319a1-de79-40f8-919e-fd164f28d448 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:16.638668 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c95319a1-de79-40f8-919e-fd164f28d448 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:16.638787 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c95319a1-de79-40f8-919e-fd164f28d448 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:16.639178 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c95319a1-de79-40f8-919e-fd164f28d448 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:16.736493 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-8606de7f-d1a1-4fa4-a356-71a1280c8586 req-e1f7b3b0-14cd-457c-8507-7be7bf07c6ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce9443a-d60b-446c-84b0-3620d5233c37", "tag": "6e93d958-2f8f-469a-b768-aa7ead1d26b0"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:16.746731 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-8606de7f-d1a1-4fa4-a356-71a1280c8586 req-e1f7b3b0-14cd-457c-8507-7be7bf07c6ad service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:16.747303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-8606de7f-d1a1-4fa4-a356-71a1280c8586 req-e1f7b3b0-14cd-457c-8507-7be7bf07c6ad service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:16.747923 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-8606de7f-d1a1-4fa4-a356-71a1280c8586 req-e1f7b3b0-14cd-457c-8507-7be7bf07c6ad service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:16.759052 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-8606de7f-d1a1-4fa4-a356-71a1280c8586 req-e1f7b3b0-14cd-457c-8507-7be7bf07c6ad service nova] Creating event network-changed:6e93d958-2f8f-469a-b768-aa7ead1d26b0 for instance 1ce9443a-d60b-446c-84b0-3620d5233c37 on hv-cinder-80152 Oct 14 03:12:16.764328 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-8606de7f-d1a1-4fa4-a356-71a1280c8586 req-e1f7b3b0-14cd-457c-8507-7be7bf07c6ad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032603 Oct 14 03:12:16.765501 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 337/688] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:16.777010 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c95319a1-de79-40f8-919e-fd164f28d448 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:16.789301 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c95319a1-de79-40f8-919e-fd164f28d448 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1361 microversion: 2.1 time: 0.163718 Oct 14 03:12:16.789894 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 352/689] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:16 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:16.812084 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-31aeaac3-e90f-4433-9890-7ffbea44decb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:16.812918 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-31aeaac3-e90f-4433-9890-7ffbea44decb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:16.819636 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-31aeaac3-e90f-4433-9890-7ffbea44decb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:16.821054 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-31aeaac3-e90f-4433-9890-7ffbea44decb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:16.821054 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-31aeaac3-e90f-4433-9890-7ffbea44decb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:16.822403 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-31aeaac3-e90f-4433-9890-7ffbea44decb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:16.823126 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-31aeaac3-e90f-4433-9890-7ffbea44decb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:16.823727 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-31aeaac3-e90f-4433-9890-7ffbea44decb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:16.966627 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-31aeaac3-e90f-4433-9890-7ffbea44decb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:16.974499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-31aeaac3-e90f-4433-9890-7ffbea44decb tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1318 microversion: 2.1 time: 0.167193 Oct 14 03:12:16.975637 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 338/690] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:16 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:17.081482 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-fe763bf8-f24b-4769-afa9-f67fe1e762c1 req-a454aa46-d422-4d6a-a1a6-8f11853b6202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec35719e-f7e5-4961-b289-277efae29da5", "name": "network-vif-plugged", "status": "completed", "tag": "0af7a28a-8080-43f0-91ce-95c4a14e9eb5"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:17.091552 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-fe763bf8-f24b-4769-afa9-f67fe1e762c1 req-a454aa46-d422-4d6a-a1a6-8f11853b6202 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:17.092046 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-fe763bf8-f24b-4769-afa9-f67fe1e762c1 req-a454aa46-d422-4d6a-a1a6-8f11853b6202 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:17.092482 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-fe763bf8-f24b-4769-afa9-f67fe1e762c1 req-a454aa46-d422-4d6a-a1a6-8f11853b6202 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:17.102978 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-fe763bf8-f24b-4769-afa9-f67fe1e762c1 req-a454aa46-d422-4d6a-a1a6-8f11853b6202 service nova] Creating event network-vif-plugged:0af7a28a-8080-43f0-91ce-95c4a14e9eb5 for instance ec35719e-f7e5-4961-b289-277efae29da5 on hv-cinder-80152 Oct 14 03:12:17.107937 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-fe763bf8-f24b-4769-afa9-f67fe1e762c1 req-a454aa46-d422-4d6a-a1a6-8f11853b6202 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030224 Oct 14 03:12:17.108546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 353/691] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:17.562407 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-5c4a0243-3e41-47d9-b3e6-3926be0e072f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:17.563779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-5c4a0243-3e41-47d9-b3e6-3926be0e072f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:17.570959 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5c4a0243-3e41-47d9-b3e6-3926be0e072f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:17.573682 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5c4a0243-3e41-47d9-b3e6-3926be0e072f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:17.573682 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5c4a0243-3e41-47d9-b3e6-3926be0e072f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:17.573682 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5c4a0243-3e41-47d9-b3e6-3926be0e072f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:17.573682 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5c4a0243-3e41-47d9-b3e6-3926be0e072f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:17.574351 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5c4a0243-3e41-47d9-b3e6-3926be0e072f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:17.745743 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5c4a0243-3e41-47d9-b3e6-3926be0e072f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:17.755938 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5c4a0243-3e41-47d9-b3e6-3926be0e072f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:17.757787 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5c4a0243-3e41-47d9-b3e6-3926be0e072f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:17.759110 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-5c4a0243-3e41-47d9-b3e6-3926be0e072f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1407 microversion: 2.20 time: 0.201584 Oct 14 03:12:17.759702 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 339/692] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:17 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:17.812990 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fe7d1282-449f-45b9-96c8-c0f13c2ea27e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:17.813699 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fe7d1282-449f-45b9-96c8-c0f13c2ea27e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:17.820908 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe7d1282-449f-45b9-96c8-c0f13c2ea27e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:17.821398 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe7d1282-449f-45b9-96c8-c0f13c2ea27e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:17.821840 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe7d1282-449f-45b9-96c8-c0f13c2ea27e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:17.822557 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe7d1282-449f-45b9-96c8-c0f13c2ea27e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:17.823009 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe7d1282-449f-45b9-96c8-c0f13c2ea27e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:17.823434 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe7d1282-449f-45b9-96c8-c0f13c2ea27e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:17.976005 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fe7d1282-449f-45b9-96c8-c0f13c2ea27e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:17.984104 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fe7d1282-449f-45b9-96c8-c0f13c2ea27e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1361 microversion: 2.1 time: 0.175417 Oct 14 03:12:17.985413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 354/693] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:17 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:17.999599 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-cd1d4837-6ba2-417a-b914-273ab3c1cf0f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:18.001411 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-cd1d4837-6ba2-417a-b914-273ab3c1cf0f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:18.008306 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cd1d4837-6ba2-417a-b914-273ab3c1cf0f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.008856 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cd1d4837-6ba2-417a-b914-273ab3c1cf0f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.009703 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cd1d4837-6ba2-417a-b914-273ab3c1cf0f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.011202 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cd1d4837-6ba2-417a-b914-273ab3c1cf0f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.012135 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cd1d4837-6ba2-417a-b914-273ab3c1cf0f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.013680 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cd1d4837-6ba2-417a-b914-273ab3c1cf0f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.037391 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fccf92fa-91b5-48ec-b021-15b793686553 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42aae591-c34c-47b8-ba6a-7ebc47fedd30"}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:18.040075 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fccf92fa-91b5-48ec-b021-15b793686553 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:18.046867 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fccf92fa-91b5-48ec-b021-15b793686553 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.047354 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fccf92fa-91b5-48ec-b021-15b793686553 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.047786 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fccf92fa-91b5-48ec-b021-15b793686553 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.049061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fccf92fa-91b5-48ec-b021-15b793686553 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.049763 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fccf92fa-91b5-48ec-b021-15b793686553 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.050190 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fccf92fa-91b5-48ec-b021-15b793686553 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.133189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-fccf92fa-91b5-48ec-b021-15b793686553 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] HTTP exception thrown: Invalid volume: volume 42aae591-c34c-47b8-ba6a-7ebc47fedd30 is already attached to instances: 3200a8b9-6447-41fb-8433-36b0283813ee Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fccf92fa-91b5-48ec-b021-15b793686553 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Request method failure captured: Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: POST /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments HTTP/1.1 Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 74 Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNKG-ky05sope_YdGjGweAljK5FUxzsY0TE3JqS7jM4jPzALKbCEnItlHGzo5Xg-IOfB8MCgv3mdaVNqvdBnmYZMENHyFWRo7_9tNs76BHsJnl6Osbo5VySDApF7HiliGWSEh0OSOTvdEIMsVWp5oVBM2GccEYCsyuR5X3gKYrX8g9g Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:12:18.135369 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:12:18.137187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:12:18.137187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:12:18.137187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:12:18.137187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:12:18.137187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:12:18.137187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:12:18.137187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:12:18.137187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 4553b7573ca34af6a9fdb94f80717f24 Oct 14 03:12:18.137187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:12:18.137187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Oct 14 03:12:18.137187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {"volumeAttachment": {"volumeId": "42aae591-c34c-47b8-ba6a-7ebc47fedd30"}} Oct 14 03:12:18.137187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Invalid volume: volume 42aae591-c34c-47b8-ba6a-7ebc47fedd30 is already attached to instances: 3200a8b9-6447-41fb-8433-36b0283813ee Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'server_id': '3200a8b9-6447-41fb-8433-36b0283813ee', 'body': {'volumeAttachment': {'volumeId': '42aae591-c34c-47b8-ba6a-7ebc47fedd30'}}} Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 42aae591-c34c-47b8-ba6a-7ebc47fedd30 is already attached to instances: 3200a8b9-6447-41fb-8433-36b0283813ee Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:18.138560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 42aae591-c34c-47b8-ba6a-7ebc47fedd30 is already attached to instances: 3200a8b9-6447-41fb-8433-36b0283813ee Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:18.139826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:18.141198 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:18.141198 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:12:18.141198 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:12:18.141198 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 42aae591-c34c-47b8-ba6a-7ebc47fedd30 is already attached to instances: 3200a8b9-6447-41fb-8433-36b0283813ee Oct 14 03:12:18.141198 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:18.141198 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fccf92fa-91b5-48ec-b021-15b793686553 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Returning 400 to user: Invalid volume: volume 42aae591-c34c-47b8-ba6a-7ebc47fedd30 is already attached to instances: 3200a8b9-6447-41fb-8433-36b0283813ee {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:12:18.141198 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fccf92fa-91b5-48ec-b021-15b793686553 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "POST /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103998 Oct 14 03:12:18.141198 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 355/694] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Oct 14 03:12:18 2022] POST /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 14 03:12:18.165303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-cd1d4837-6ba2-417a-b914-273ab3c1cf0f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:18.177426 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-cd1d4837-6ba2-417a-b914-273ab3c1cf0f tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1318 microversion: 2.1 time: 0.179306 Oct 14 03:12:18.177426 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 340/695] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:17 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:18.205119 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-2f5441b8-7207-4e5b-973c-2a8c7bf38322 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:18.205608 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-2f5441b8-7207-4e5b-973c-2a8c7bf38322 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:18.211464 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f5441b8-7207-4e5b-973c-2a8c7bf38322 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.212138 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f5441b8-7207-4e5b-973c-2a8c7bf38322 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.212756 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f5441b8-7207-4e5b-973c-2a8c7bf38322 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.213592 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f5441b8-7207-4e5b-973c-2a8c7bf38322 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.214193 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f5441b8-7207-4e5b-973c-2a8c7bf38322 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.214780 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2f5441b8-7207-4e5b-973c-2a8c7bf38322 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.294300 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-2f5441b8-7207-4e5b-973c-2a8c7bf38322 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lazy-loading 'services' on Instance uuid 3200a8b9-6447-41fb-8433-36b0283813ee {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:18.467992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-2f5441b8-7207-4e5b-973c-2a8c7bf38322 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments/42aae591-c34c-47b8-ba6a-7ebc47fedd30" status: 202 len: 0 microversion: 2.1 time: 0.266509 Oct 14 03:12:18.468529 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 356/696] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Oct 14 03:12:18 2022] DELETE /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments/42aae591-c34c-47b8-ba6a-7ebc47fedd30 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:12:18.477184 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e7389414-0374-479f-9924-ed68fe1599ad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:18.479446 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e7389414-0374-479f-9924-ed68fe1599ad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:18.486179 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7389414-0374-479f-9924-ed68fe1599ad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.486654 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7389414-0374-479f-9924-ed68fe1599ad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.487111 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7389414-0374-479f-9924-ed68fe1599ad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.487806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7389414-0374-479f-9924-ed68fe1599ad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.488236 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7389414-0374-479f-9924-ed68fe1599ad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.488696 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7389414-0374-479f-9924-ed68fe1599ad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.517030 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e7389414-0374-479f-9924-ed68fe1599ad tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043978 Oct 14 03:12:18.517567 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 341/697] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:18 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:18.787744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-07ec1b58-988d-456c-a6b5-cc9e586e2456 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:18.788362 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-07ec1b58-988d-456c-a6b5-cc9e586e2456 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:18.795290 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-07ec1b58-988d-456c-a6b5-cc9e586e2456 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.795831 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-07ec1b58-988d-456c-a6b5-cc9e586e2456 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.796273 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-07ec1b58-988d-456c-a6b5-cc9e586e2456 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.796988 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-07ec1b58-988d-456c-a6b5-cc9e586e2456 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.797440 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-07ec1b58-988d-456c-a6b5-cc9e586e2456 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.797861 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-07ec1b58-988d-456c-a6b5-cc9e586e2456 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.928414 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-07ec1b58-988d-456c-a6b5-cc9e586e2456 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:18.936608 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-07ec1b58-988d-456c-a6b5-cc9e586e2456 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:18.938054 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-07ec1b58-988d-456c-a6b5-cc9e586e2456 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:18.939150 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-07ec1b58-988d-456c-a6b5-cc9e586e2456 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1407 microversion: 2.20 time: 0.155762 Oct 14 03:12:18.939709 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 357/698] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:18 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:19.008148 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c32b0275-e29c-4d9f-81ce-ae565dd9af6a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:19.008843 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c32b0275-e29c-4d9f-81ce-ae565dd9af6a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:19.015269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c32b0275-e29c-4d9f-81ce-ae565dd9af6a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.015751 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c32b0275-e29c-4d9f-81ce-ae565dd9af6a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.016189 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c32b0275-e29c-4d9f-81ce-ae565dd9af6a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.016937 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c32b0275-e29c-4d9f-81ce-ae565dd9af6a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.017407 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c32b0275-e29c-4d9f-81ce-ae565dd9af6a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.017833 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c32b0275-e29c-4d9f-81ce-ae565dd9af6a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.122791 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-af7a369b-1687-468a-818c-d10e66c4ecfa req-f2172d46-b7aa-4cb9-8f51-f46041fda64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c6bac7-dcd5-4fd2-b81d-682898442716", "name": "network-vif-plugged", "status": "completed", "tag": "a0776357-4e9e-4296-84d0-654e4b00c042"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:19.132289 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-af7a369b-1687-468a-818c-d10e66c4ecfa req-f2172d46-b7aa-4cb9-8f51-f46041fda64f service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.132809 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-af7a369b-1687-468a-818c-d10e66c4ecfa req-f2172d46-b7aa-4cb9-8f51-f46041fda64f service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.133387 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-af7a369b-1687-468a-818c-d10e66c4ecfa req-f2172d46-b7aa-4cb9-8f51-f46041fda64f service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.143865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c32b0275-e29c-4d9f-81ce-ae565dd9af6a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:19.145442 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-af7a369b-1687-468a-818c-d10e66c4ecfa req-f2172d46-b7aa-4cb9-8f51-f46041fda64f service nova] Creating event network-vif-plugged:a0776357-4e9e-4296-84d0-654e4b00c042 for instance b7c6bac7-dcd5-4fd2-b81d-682898442716 on hv-cinder-80152 Oct 14 03:12:19.150166 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-af7a369b-1687-468a-818c-d10e66c4ecfa req-f2172d46-b7aa-4cb9-8f51-f46041fda64f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031009 Oct 14 03:12:19.150761 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 358/699] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:19.152364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c32b0275-e29c-4d9f-81ce-ae565dd9af6a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1361 microversion: 2.1 time: 0.148101 Oct 14 03:12:19.153045 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 342/700] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:19 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:19.197147 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ec0e0b9a-8775-4c5c-a397-7d811edbf3af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:19.197854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ec0e0b9a-8775-4c5c-a397-7d811edbf3af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:19.204377 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec0e0b9a-8775-4c5c-a397-7d811edbf3af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.204893 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec0e0b9a-8775-4c5c-a397-7d811edbf3af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.205336 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec0e0b9a-8775-4c5c-a397-7d811edbf3af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.206026 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec0e0b9a-8775-4c5c-a397-7d811edbf3af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.206482 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec0e0b9a-8775-4c5c-a397-7d811edbf3af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.206910 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec0e0b9a-8775-4c5c-a397-7d811edbf3af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.275175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-61577700-a075-4a44-993e-dfc5bea33fe6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:19.275757 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-61577700-a075-4a44-993e-dfc5bea33fe6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:19.284521 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-61577700-a075-4a44-993e-dfc5bea33fe6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.285111 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-61577700-a075-4a44-993e-dfc5bea33fe6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.285615 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-61577700-a075-4a44-993e-dfc5bea33fe6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.286524 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-61577700-a075-4a44-993e-dfc5bea33fe6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.287427 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-61577700-a075-4a44-993e-dfc5bea33fe6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.288260 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-61577700-a075-4a44-993e-dfc5bea33fe6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.339507 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ec0e0b9a-8775-4c5c-a397-7d811edbf3af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:19.347783 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ec0e0b9a-8775-4c5c-a397-7d811edbf3af tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1318 microversion: 2.1 time: 0.154605 Oct 14 03:12:19.348354 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 359/701] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:19 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:19.372190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-61577700-a075-4a44-993e-dfc5bea33fe6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lazy-loading 'services' on Instance uuid a2ae6b50-1d01-420e-ab83-6c856e0b35d4 {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:19.529373 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e9c6b48c-ea72-4f45-b4df-6fa5258f3cc4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:19.531574 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e9c6b48c-ea72-4f45-b4df-6fa5258f3cc4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:19.537556 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e9c6b48c-ea72-4f45-b4df-6fa5258f3cc4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.538035 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e9c6b48c-ea72-4f45-b4df-6fa5258f3cc4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.539324 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e9c6b48c-ea72-4f45-b4df-6fa5258f3cc4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.539324 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e9c6b48c-ea72-4f45-b4df-6fa5258f3cc4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.539562 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e9c6b48c-ea72-4f45-b4df-6fa5258f3cc4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.540031 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e9c6b48c-ea72-4f45-b4df-6fa5258f3cc4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.565302 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-61577700-a075-4a44-993e-dfc5bea33fe6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments/d161baf5-cb1b-4b1a-84fc-0437d6ba38b1" status: 202 len: 0 microversion: 2.1 time: 0.293911 Oct 14 03:12:19.565924 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 343/702] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Oct 14 03:12:19 2022] DELETE /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments/d161baf5-cb1b-4b1a-84fc-0437d6ba38b1 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 03:12:19.568930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e9c6b48c-ea72-4f45-b4df-6fa5258f3cc4 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 Oct 14 03:12:19.569482 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 360/703] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:19 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:19.574727 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-5a9da6b8-2e65-45ab-96b1-49083cc43cad tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:19.577726 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-5a9da6b8-2e65-45ab-96b1-49083cc43cad tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:19.583754 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5a9da6b8-2e65-45ab-96b1-49083cc43cad tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.584242 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5a9da6b8-2e65-45ab-96b1-49083cc43cad tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.584721 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5a9da6b8-2e65-45ab-96b1-49083cc43cad tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.585420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5a9da6b8-2e65-45ab-96b1-49083cc43cad tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.585892 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5a9da6b8-2e65-45ab-96b1-49083cc43cad tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.586301 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5a9da6b8-2e65-45ab-96b1-49083cc43cad tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.614757 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-5a9da6b8-2e65-45ab-96b1-49083cc43cad tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Oct 14 03:12:19.615243 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 344/704] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:19 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:19.963200 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b58ba5ee-c5e5-471b-a43f-15e7918ca386 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:19.963755 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b58ba5ee-c5e5-471b-a43f-15e7918ca386 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:19.970090 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b58ba5ee-c5e5-471b-a43f-15e7918ca386 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.970561 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b58ba5ee-c5e5-471b-a43f-15e7918ca386 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.970989 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b58ba5ee-c5e5-471b-a43f-15e7918ca386 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.971666 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b58ba5ee-c5e5-471b-a43f-15e7918ca386 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.972113 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b58ba5ee-c5e5-471b-a43f-15e7918ca386 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.972566 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b58ba5ee-c5e5-471b-a43f-15e7918ca386 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:20.100611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b58ba5ee-c5e5-471b-a43f-15e7918ca386 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:20.109408 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b58ba5ee-c5e5-471b-a43f-15e7918ca386 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:20.111110 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b58ba5ee-c5e5-471b-a43f-15e7918ca386 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:20.112218 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b58ba5ee-c5e5-471b-a43f-15e7918ca386 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1407 microversion: 2.20 time: 0.153033 Oct 14 03:12:20.112802 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 361/705] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:19 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:20.175535 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ea011a12-525d-4954-ae0d-eca6185ac2b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:20.176162 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ea011a12-525d-4954-ae0d-eca6185ac2b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:20.182560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea011a12-525d-4954-ae0d-eca6185ac2b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:20.185699 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea011a12-525d-4954-ae0d-eca6185ac2b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:20.185699 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea011a12-525d-4954-ae0d-eca6185ac2b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:20.185699 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea011a12-525d-4954-ae0d-eca6185ac2b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:20.185699 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea011a12-525d-4954-ae0d-eca6185ac2b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:20.186074 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea011a12-525d-4954-ae0d-eca6185ac2b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:20.315588 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ea011a12-525d-4954-ae0d-eca6185ac2b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:20.323189 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ea011a12-525d-4954-ae0d-eca6185ac2b6 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1361 microversion: 2.1 time: 0.151524 Oct 14 03:12:20.323796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 345/706] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:20 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:20.370772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5d021868-c27a-43f1-9b81-b54eec21f726 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:20.371379 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5d021868-c27a-43f1-9b81-b54eec21f726 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:20.377355 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5d021868-c27a-43f1-9b81-b54eec21f726 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:20.380620 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5d021868-c27a-43f1-9b81-b54eec21f726 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:20.380620 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5d021868-c27a-43f1-9b81-b54eec21f726 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:20.380620 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5d021868-c27a-43f1-9b81-b54eec21f726 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:20.380620 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5d021868-c27a-43f1-9b81-b54eec21f726 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:20.381135 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5d021868-c27a-43f1-9b81-b54eec21f726 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:20.505440 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5d021868-c27a-43f1-9b81-b54eec21f726 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:20.513111 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5d021868-c27a-43f1-9b81-b54eec21f726 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1507 microversion: 2.1 time: 0.146129 Oct 14 03:12:20.513605 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 362/707] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:20 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:20.535736 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-58289f35-820a-4d9d-ab9d-0141ef811212 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd1db9a1-d651-4fab-8c77-36ed1a234674", "device": "/dev/sdb"}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:20.538850 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-58289f35-820a-4d9d-ab9d-0141ef811212 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:20.545592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-58289f35-820a-4d9d-ab9d-0141ef811212 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:20.546111 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-58289f35-820a-4d9d-ab9d-0141ef811212 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:20.546556 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-58289f35-820a-4d9d-ab9d-0141ef811212 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:20.547250 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-58289f35-820a-4d9d-ab9d-0141ef811212 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:20.547710 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-58289f35-820a-4d9d-ab9d-0141ef811212 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:20.548138 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-58289f35-820a-4d9d-ab9d-0141ef811212 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:20.584811 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-2989793d-a9e4-483d-a797-b40def8daf2c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:20.587146 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-2989793d-a9e4-483d-a797-b40def8daf2c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:20.593556 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2989793d-a9e4-483d-a797-b40def8daf2c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:20.594044 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2989793d-a9e4-483d-a797-b40def8daf2c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:20.594481 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2989793d-a9e4-483d-a797-b40def8daf2c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:20.595212 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2989793d-a9e4-483d-a797-b40def8daf2c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:20.595663 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2989793d-a9e4-483d-a797-b40def8daf2c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:20.596084 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2989793d-a9e4-483d-a797-b40def8daf2c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:20.628241 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-2989793d-a9e4-483d-a797-b40def8daf2c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047368 Oct 14 03:12:20.629007 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 363/708] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:20 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:20.633455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-323667f7-6f80-4c49-8baf-9b88d3f05e2d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:20.635528 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-323667f7-6f80-4c49-8baf-9b88d3f05e2d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:20.641581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-323667f7-6f80-4c49-8baf-9b88d3f05e2d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:20.642068 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-323667f7-6f80-4c49-8baf-9b88d3f05e2d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:20.642503 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-323667f7-6f80-4c49-8baf-9b88d3f05e2d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:20.643186 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-323667f7-6f80-4c49-8baf-9b88d3f05e2d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:20.643673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-323667f7-6f80-4c49-8baf-9b88d3f05e2d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:20.644102 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-323667f7-6f80-4c49-8baf-9b88d3f05e2d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:20.673577 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-323667f7-6f80-4c49-8baf-9b88d3f05e2d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043657 Oct 14 03:12:20.674137 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 364/709] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:20 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:21.143909 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fe0888b5-371e-4603-9f9e-9db2ad58f024 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:21.144638 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fe0888b5-371e-4603-9f9e-9db2ad58f024 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:21.150850 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe0888b5-371e-4603-9f9e-9db2ad58f024 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:21.151330 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe0888b5-371e-4603-9f9e-9db2ad58f024 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:21.151763 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe0888b5-371e-4603-9f9e-9db2ad58f024 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:21.152557 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe0888b5-371e-4603-9f9e-9db2ad58f024 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:21.153129 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe0888b5-371e-4603-9f9e-9db2ad58f024 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:21.153553 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe0888b5-371e-4603-9f9e-9db2ad58f024 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:21.295146 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fe0888b5-371e-4603-9f9e-9db2ad58f024 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:21.303643 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fe0888b5-371e-4603-9f9e-9db2ad58f024 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:21.305120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fe0888b5-371e-4603-9f9e-9db2ad58f024 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:21.306217 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fe0888b5-371e-4603-9f9e-9db2ad58f024 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1407 microversion: 2.20 time: 0.166844 Oct 14 03:12:21.306770 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 365/710] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:21 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:12:21.345119 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e15e5900-c312-4890-ac17-42d384562d1b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:21.345717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e15e5900-c312-4890-ac17-42d384562d1b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:21.351898 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e15e5900-c312-4890-ac17-42d384562d1b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:21.352498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e15e5900-c312-4890-ac17-42d384562d1b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:21.352939 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e15e5900-c312-4890-ac17-42d384562d1b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:21.353648 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e15e5900-c312-4890-ac17-42d384562d1b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:21.354100 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e15e5900-c312-4890-ac17-42d384562d1b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:21.354521 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e15e5900-c312-4890-ac17-42d384562d1b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:21.359111 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:21.483344 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-e15e5900-c312-4890-ac17-42d384562d1b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:21.491170 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e15e5900-c312-4890-ac17-42d384562d1b tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1361 microversion: 2.1 time: 0.150223 Oct 14 03:12:21.491732 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 366/711] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:21 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:21.640910 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ccda366f-9867-4be4-97d6-635fc3180577 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:21.643115 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ccda366f-9867-4be4-97d6-635fc3180577 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:21.649136 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ccda366f-9867-4be4-97d6-635fc3180577 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:21.649613 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ccda366f-9867-4be4-97d6-635fc3180577 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:21.650044 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ccda366f-9867-4be4-97d6-635fc3180577 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:21.650748 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ccda366f-9867-4be4-97d6-635fc3180577 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:21.651202 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ccda366f-9867-4be4-97d6-635fc3180577 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:21.651623 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ccda366f-9867-4be4-97d6-635fc3180577 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:21.681336 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ccda366f-9867-4be4-97d6-635fc3180577 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Oct 14 03:12:21.681889 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 367/712] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:21 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:21.686349 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-975a8b58-5302-4d3a-b8a5-838177ebc755 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:21.688479 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-975a8b58-5302-4d3a-b8a5-838177ebc755 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:21.693896 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-975a8b58-5302-4d3a-b8a5-838177ebc755 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:21.694375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-975a8b58-5302-4d3a-b8a5-838177ebc755 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:21.694804 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-975a8b58-5302-4d3a-b8a5-838177ebc755 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:21.695484 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-975a8b58-5302-4d3a-b8a5-838177ebc755 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:21.695933 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-975a8b58-5302-4d3a-b8a5-838177ebc755 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:21.696354 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-975a8b58-5302-4d3a-b8a5-838177ebc755 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:21.725516 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-975a8b58-5302-4d3a-b8a5-838177ebc755 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042661 Oct 14 03:12:21.726058 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 368/713] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:21 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:22.009301 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=4 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:22.030863 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=18 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:22.319563 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-58289f35-820a-4d9d-ab9d-0141ef811212 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "POST /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.787712 Oct 14 03:12:22.320529 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 346/714] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Oct 14 03:12:20 2022] POST /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5/os-volume_attachments => generated 194 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:22.331430 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-44413bae-3e05-43c1-b117-c2324e1c5e24 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:22.331987 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-44413bae-3e05-43c1-b117-c2324e1c5e24 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:22.334584 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=14 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:22.339605 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-44413bae-3e05-43c1-b117-c2324e1c5e24 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:22.340090 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-44413bae-3e05-43c1-b117-c2324e1c5e24 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:22.340559 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-44413bae-3e05-43c1-b117-c2324e1c5e24 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:22.341260 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-44413bae-3e05-43c1-b117-c2324e1c5e24 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:22.341736 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-44413bae-3e05-43c1-b117-c2324e1c5e24 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:22.342388 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-44413bae-3e05-43c1-b117-c2324e1c5e24 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:22.480366 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-44413bae-3e05-43c1-b117-c2324e1c5e24 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:22.489361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-44413bae-3e05-43c1-b117-c2324e1c5e24 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:22.490822 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-44413bae-3e05-43c1-b117-c2324e1c5e24 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:22.491922 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-44413bae-3e05-43c1-b117-c2324e1c5e24 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1407 microversion: 2.20 time: 0.164477 Oct 14 03:12:22.492493 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 369/715] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:22 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:12:22.514747 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e2afd2d4-9358-4fdc-ad75-941a8f1e2e92 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:22.515462 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e2afd2d4-9358-4fdc-ad75-941a8f1e2e92 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:22.521786 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e2afd2d4-9358-4fdc-ad75-941a8f1e2e92 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:22.522269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e2afd2d4-9358-4fdc-ad75-941a8f1e2e92 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:22.522712 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e2afd2d4-9358-4fdc-ad75-941a8f1e2e92 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:22.523406 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e2afd2d4-9358-4fdc-ad75-941a8f1e2e92 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:22.524033 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e2afd2d4-9358-4fdc-ad75-941a8f1e2e92 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:22.525685 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e2afd2d4-9358-4fdc-ad75-941a8f1e2e92 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:22.680419 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e2afd2d4-9358-4fdc-ad75-941a8f1e2e92 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:22.688003 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e2afd2d4-9358-4fdc-ad75-941a8f1e2e92 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1361 microversion: 2.1 time: 0.177901 Oct 14 03:12:22.688691 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 347/716] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:22 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:22.694192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f519d91b-371e-41c7-bba8-0c5869ec3b8e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:22.696504 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f519d91b-371e-41c7-bba8-0c5869ec3b8e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:22.702740 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f519d91b-371e-41c7-bba8-0c5869ec3b8e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:22.703231 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f519d91b-371e-41c7-bba8-0c5869ec3b8e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:22.703671 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f519d91b-371e-41c7-bba8-0c5869ec3b8e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:22.704374 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f519d91b-371e-41c7-bba8-0c5869ec3b8e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:22.704856 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f519d91b-371e-41c7-bba8-0c5869ec3b8e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:22.705283 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f519d91b-371e-41c7-bba8-0c5869ec3b8e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:22.735375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f519d91b-371e-41c7-bba8-0c5869ec3b8e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045519 Oct 14 03:12:22.738386 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 370/717] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:22 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 14 03:12:22.739089 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e7a0665d-2657-4e17-b0a1-a2ea84b37fd0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:22.742547 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e7a0665d-2657-4e17-b0a1-a2ea84b37fd0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:22.749267 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7a0665d-2657-4e17-b0a1-a2ea84b37fd0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:22.749754 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7a0665d-2657-4e17-b0a1-a2ea84b37fd0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:22.750191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7a0665d-2657-4e17-b0a1-a2ea84b37fd0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:22.750960 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7a0665d-2657-4e17-b0a1-a2ea84b37fd0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:22.751415 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7a0665d-2657-4e17-b0a1-a2ea84b37fd0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:22.752429 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7a0665d-2657-4e17-b0a1-a2ea84b37fd0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:22.783696 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e7a0665d-2657-4e17-b0a1-a2ea84b37fd0 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049876 Oct 14 03:12:22.784280 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 348/718] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:22 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:22.813197 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0b9e7f60-1b5a-486f-9c71-b57ff2a9854a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:22.813700 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0b9e7f60-1b5a-486f-9c71-b57ff2a9854a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:22.819511 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0b9e7f60-1b5a-486f-9c71-b57ff2a9854a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:22.820004 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0b9e7f60-1b5a-486f-9c71-b57ff2a9854a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:22.820468 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0b9e7f60-1b5a-486f-9c71-b57ff2a9854a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:22.821172 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0b9e7f60-1b5a-486f-9c71-b57ff2a9854a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:22.821670 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0b9e7f60-1b5a-486f-9c71-b57ff2a9854a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:22.822102 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0b9e7f60-1b5a-486f-9c71-b57ff2a9854a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:22.847299 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0b9e7f60-1b5a-486f-9c71-b57ff2a9854a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Going to try to terminate instance {{(pid=119301) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:12:23.103935 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0b9e7f60-1b5a-486f-9c71-b57ff2a9854a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 204 len: 0 microversion: 2.1 time: 0.294368 Oct 14 03:12:23.104533 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 371/719] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:12:22 2022] DELETE /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:12:23.112766 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-dc71858b-d4c1-4a2c-bb36-918065d4ac25 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:23.113372 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-dc71858b-d4c1-4a2c-bb36-918065d4ac25 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:23.119761 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dc71858b-d4c1-4a2c-bb36-918065d4ac25 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:23.120249 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dc71858b-d4c1-4a2c-bb36-918065d4ac25 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:23.120717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dc71858b-d4c1-4a2c-bb36-918065d4ac25 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:23.121412 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dc71858b-d4c1-4a2c-bb36-918065d4ac25 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:23.121863 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dc71858b-d4c1-4a2c-bb36-918065d4ac25 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:23.122285 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dc71858b-d4c1-4a2c-bb36-918065d4ac25 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:23.259401 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-dc71858b-d4c1-4a2c-bb36-918065d4ac25 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:23.267998 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-dc71858b-d4c1-4a2c-bb36-918065d4ac25 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1679 microversion: 2.1 time: 0.159251 Oct 14 03:12:23.268593 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 349/720] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:23 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:23.519075 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-70b596d5-5eee-48b1-80fe-fbff7f2cffb1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:23.519675 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-70b596d5-5eee-48b1-80fe-fbff7f2cffb1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:23.526093 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-70b596d5-5eee-48b1-80fe-fbff7f2cffb1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:23.526565 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-70b596d5-5eee-48b1-80fe-fbff7f2cffb1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:23.526999 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-70b596d5-5eee-48b1-80fe-fbff7f2cffb1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:23.527684 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-70b596d5-5eee-48b1-80fe-fbff7f2cffb1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:23.528134 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-70b596d5-5eee-48b1-80fe-fbff7f2cffb1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:23.528590 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-70b596d5-5eee-48b1-80fe-fbff7f2cffb1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:23.659818 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-70b596d5-5eee-48b1-80fe-fbff7f2cffb1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:23.668336 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-70b596d5-5eee-48b1-80fe-fbff7f2cffb1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:23.671609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-70b596d5-5eee-48b1-80fe-fbff7f2cffb1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:23.671609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-70b596d5-5eee-48b1-80fe-fbff7f2cffb1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1599 microversion: 2.20 time: 0.158083 Oct 14 03:12:23.672039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 372/721] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:23 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:23.696846 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2528bb95-1f47-4840-ae09-5e9b09658b3f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:23.697337 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2528bb95-1f47-4840-ae09-5e9b09658b3f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:23.703419 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2528bb95-1f47-4840-ae09-5e9b09658b3f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:23.703945 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2528bb95-1f47-4840-ae09-5e9b09658b3f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:23.704432 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2528bb95-1f47-4840-ae09-5e9b09658b3f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:23.705128 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2528bb95-1f47-4840-ae09-5e9b09658b3f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:23.705578 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2528bb95-1f47-4840-ae09-5e9b09658b3f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:23.706004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2528bb95-1f47-4840-ae09-5e9b09658b3f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:23.710709 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d28211e4-9676-4481-b5e8-d4c56cbc4cc3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:23.711322 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d28211e4-9676-4481-b5e8-d4c56cbc4cc3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:23.717248 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d28211e4-9676-4481-b5e8-d4c56cbc4cc3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:23.717733 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d28211e4-9676-4481-b5e8-d4c56cbc4cc3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:23.718169 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d28211e4-9676-4481-b5e8-d4c56cbc4cc3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:23.718863 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d28211e4-9676-4481-b5e8-d4c56cbc4cc3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:23.719318 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d28211e4-9676-4481-b5e8-d4c56cbc4cc3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:23.719750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d28211e4-9676-4481-b5e8-d4c56cbc4cc3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:23.808769 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2528bb95-1f47-4840-ae09-5e9b09658b3f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.115826 Oct 14 03:12:23.809377 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 350/722] 10.222.0.13 () {60 vars in 1316 bytes} [Fri Oct 14 03:12:23 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:12:23.814713 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-24ed5ca5-b068-4c99-9ce5-d3a3fe7857f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:23.816987 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-24ed5ca5-b068-4c99-9ce5-d3a3fe7857f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:23.823120 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24ed5ca5-b068-4c99-9ce5-d3a3fe7857f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:23.823606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24ed5ca5-b068-4c99-9ce5-d3a3fe7857f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:23.824346 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24ed5ca5-b068-4c99-9ce5-d3a3fe7857f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:23.825075 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24ed5ca5-b068-4c99-9ce5-d3a3fe7857f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:23.825534 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24ed5ca5-b068-4c99-9ce5-d3a3fe7857f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:23.825963 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24ed5ca5-b068-4c99-9ce5-d3a3fe7857f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:23.852659 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:23.858464 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-24ed5ca5-b068-4c99-9ce5-d3a3fe7857f8 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047561 Oct 14 03:12:23.859159 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 351/723] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:23 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:12:23.879064 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d28211e4-9676-4481-b5e8-d4c56cbc4cc3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:23.885221 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d28211e4-9676-4481-b5e8-d4c56cbc4cc3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1361 microversion: 2.1 time: 0.178284 Oct 14 03:12:23.886005 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 373/724] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:23 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:23.939880 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-23b33a59-ef96-4d4a-b841-daa51d847f0e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:23.940378 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-23b33a59-ef96-4d4a-b841-daa51d847f0e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:23.946854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-23b33a59-ef96-4d4a-b841-daa51d847f0e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:23.947329 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-23b33a59-ef96-4d4a-b841-daa51d847f0e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:23.947763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-23b33a59-ef96-4d4a-b841-daa51d847f0e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:23.948480 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-23b33a59-ef96-4d4a-b841-daa51d847f0e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:23.948933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-23b33a59-ef96-4d4a-b841-daa51d847f0e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:23.949356 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-23b33a59-ef96-4d4a-b841-daa51d847f0e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:23.974045 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-23b33a59-ef96-4d4a-b841-daa51d847f0e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Going to try to terminate instance {{(pid=119302) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:12:24.242912 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-23b33a59-ef96-4d4a-b841-daa51d847f0e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 204 len: 0 microversion: 2.1 time: 0.306571 Oct 14 03:12:24.246979 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 352/725] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:12:23 2022] DELETE /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:12:24.250528 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-88473629-11cd-424c-adc8-b151c6d0f6c1 req-dce805f1-dcff-42a1-962a-214b12be5d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce9443a-d60b-446c-84b0-3620d5233c37", "name": "network-vif-plugged", "status": "completed", "tag": "6e93d958-2f8f-469a-b768-aa7ead1d26b0"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:24.252977 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-5746102d-488c-4378-8fd3-29ef37027faf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:24.253901 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-5746102d-488c-4378-8fd3-29ef37027faf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:24.260750 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5746102d-488c-4378-8fd3-29ef37027faf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:24.261445 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5746102d-488c-4378-8fd3-29ef37027faf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:24.262070 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5746102d-488c-4378-8fd3-29ef37027faf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:24.262688 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-88473629-11cd-424c-adc8-b151c6d0f6c1 req-dce805f1-dcff-42a1-962a-214b12be5d42 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:24.263174 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-88473629-11cd-424c-adc8-b151c6d0f6c1 req-dce805f1-dcff-42a1-962a-214b12be5d42 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:24.263375 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5746102d-488c-4378-8fd3-29ef37027faf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:24.263662 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-88473629-11cd-424c-adc8-b151c6d0f6c1 req-dce805f1-dcff-42a1-962a-214b12be5d42 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:24.263888 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5746102d-488c-4378-8fd3-29ef37027faf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:24.265024 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5746102d-488c-4378-8fd3-29ef37027faf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:24.276043 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-88473629-11cd-424c-adc8-b151c6d0f6c1 req-dce805f1-dcff-42a1-962a-214b12be5d42 service nova] Creating event network-vif-plugged:6e93d958-2f8f-469a-b768-aa7ead1d26b0 for instance 1ce9443a-d60b-446c-84b0-3620d5233c37 on hv-cinder-80152 Oct 14 03:12:24.281648 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-88473629-11cd-424c-adc8-b151c6d0f6c1 req-dce805f1-dcff-42a1-962a-214b12be5d42 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037027 Oct 14 03:12:24.282577 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 374/726] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:24.291385 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a705acc4-f39d-49bb-8288-30b4621aa335 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:24.292129 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a705acc4-f39d-49bb-8288-30b4621aa335 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:24.294105 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:24.299593 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a705acc4-f39d-49bb-8288-30b4621aa335 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:24.300089 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a705acc4-f39d-49bb-8288-30b4621aa335 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:24.300561 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a705acc4-f39d-49bb-8288-30b4621aa335 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:24.301268 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a705acc4-f39d-49bb-8288-30b4621aa335 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:24.301748 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a705acc4-f39d-49bb-8288-30b4621aa335 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:24.302276 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a705acc4-f39d-49bb-8288-30b4621aa335 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:24.473836 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5746102d-488c-4378-8fd3-29ef37027faf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:24.496732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-5746102d-488c-4378-8fd3-29ef37027faf tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1688 microversion: 2.1 time: 0.236774 Oct 14 03:12:24.496732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 353/727] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:24 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1688 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:24.496934 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a705acc4-f39d-49bb-8288-30b4621aa335 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:24.497133 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a705acc4-f39d-49bb-8288-30b4621aa335 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1679 microversion: 2.1 time: 0.209854 Oct 14 03:12:24.502139 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 375/728] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:24 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1679 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:24.844090 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-01d24658-ed5d-4e42-8cff-c70262c083d8 req-7833de6d-ad62-422e-9b6c-eb1f964b46bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7c6bac7-dcd5-4fd2-b81d-682898442716", "tag": "a0776357-4e9e-4296-84d0-654e4b00c042"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:24.853386 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-01d24658-ed5d-4e42-8cff-c70262c083d8 req-7833de6d-ad62-422e-9b6c-eb1f964b46bb service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:24.853871 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-01d24658-ed5d-4e42-8cff-c70262c083d8 req-7833de6d-ad62-422e-9b6c-eb1f964b46bb service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:24.854303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-01d24658-ed5d-4e42-8cff-c70262c083d8 req-7833de6d-ad62-422e-9b6c-eb1f964b46bb service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:24.866942 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-01d24658-ed5d-4e42-8cff-c70262c083d8 req-7833de6d-ad62-422e-9b6c-eb1f964b46bb service nova] Creating event network-changed:a0776357-4e9e-4296-84d0-654e4b00c042 for instance b7c6bac7-dcd5-4fd2-b81d-682898442716 on hv-cinder-80152 Oct 14 03:12:24.871855 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-01d24658-ed5d-4e42-8cff-c70262c083d8 req-7833de6d-ad62-422e-9b6c-eb1f964b46bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031465 Oct 14 03:12:24.872668 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 354/729] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:24.908493 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-80973c2f-b7c3-4731-96ba-e1af21888e37 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:24.909105 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-80973c2f-b7c3-4731-96ba-e1af21888e37 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:24.915585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-80973c2f-b7c3-4731-96ba-e1af21888e37 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:24.916066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-80973c2f-b7c3-4731-96ba-e1af21888e37 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:24.916537 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-80973c2f-b7c3-4731-96ba-e1af21888e37 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:24.917234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-80973c2f-b7c3-4731-96ba-e1af21888e37 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:24.917690 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-80973c2f-b7c3-4731-96ba-e1af21888e37 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:24.918115 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-80973c2f-b7c3-4731-96ba-e1af21888e37 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:25.049645 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-80973c2f-b7c3-4731-96ba-e1af21888e37 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:25.057275 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-80973c2f-b7c3-4731-96ba-e1af21888e37 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1361 microversion: 2.1 time: 0.153105 Oct 14 03:12:25.057842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 376/730] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:24 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:25.513099 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9217a692-d66d-4e47-952b-196e7a7982e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:25.515601 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9217a692-d66d-4e47-952b-196e7a7982e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:25.521045 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5756657a-5ce8-43c5-ac53-5320b98cc69c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:25.521590 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5756657a-5ce8-43c5-ac53-5320b98cc69c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:25.522485 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9217a692-d66d-4e47-952b-196e7a7982e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:25.523224 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9217a692-d66d-4e47-952b-196e7a7982e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:25.523693 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9217a692-d66d-4e47-952b-196e7a7982e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:25.524659 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9217a692-d66d-4e47-952b-196e7a7982e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:25.525181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9217a692-d66d-4e47-952b-196e7a7982e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:25.525887 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9217a692-d66d-4e47-952b-196e7a7982e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:25.527861 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5756657a-5ce8-43c5-ac53-5320b98cc69c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:25.528344 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5756657a-5ce8-43c5-ac53-5320b98cc69c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:25.528927 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5756657a-5ce8-43c5-ac53-5320b98cc69c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:25.529494 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5756657a-5ce8-43c5-ac53-5320b98cc69c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:25.529945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5756657a-5ce8-43c5-ac53-5320b98cc69c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:25.532231 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5756657a-5ce8-43c5-ac53-5320b98cc69c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:25.742878 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9217a692-d66d-4e47-952b-196e7a7982e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:25.744433 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5756657a-5ce8-43c5-ac53-5320b98cc69c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:25.752214 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9217a692-d66d-4e47-952b-196e7a7982e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1688 microversion: 2.1 time: 0.244673 Oct 14 03:12:25.752818 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 355/731] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:25 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1688 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:25.753330 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5756657a-5ce8-43c5-ac53-5320b98cc69c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1679 microversion: 2.1 time: 0.235534 Oct 14 03:12:25.754208 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 377/732] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:25 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1679 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:26.080900 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6d43d655-73d7-4560-9dc7-10d68d02b58a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:26.081515 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6d43d655-73d7-4560-9dc7-10d68d02b58a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:26.083449 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:26.088240 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d43d655-73d7-4560-9dc7-10d68d02b58a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:26.088763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d43d655-73d7-4560-9dc7-10d68d02b58a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:26.089260 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d43d655-73d7-4560-9dc7-10d68d02b58a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:26.091779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d43d655-73d7-4560-9dc7-10d68d02b58a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:26.091779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d43d655-73d7-4560-9dc7-10d68d02b58a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:26.091779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6d43d655-73d7-4560-9dc7-10d68d02b58a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:26.228514 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6d43d655-73d7-4560-9dc7-10d68d02b58a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:26.236512 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6d43d655-73d7-4560-9dc7-10d68d02b58a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1361 microversion: 2.1 time: 0.160039 Oct 14 03:12:26.237090 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 356/733] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:26 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:26.775213 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a1a25916-56f9-4223-944d-460eba40fe8c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:26.775971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a1a25916-56f9-4223-944d-460eba40fe8c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:26.777070 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-268954f2-41e1-4423-950b-ff1a763bf40e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:26.777715 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-268954f2-41e1-4423-950b-ff1a763bf40e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:26.782215 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a1a25916-56f9-4223-944d-460eba40fe8c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:26.782701 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a1a25916-56f9-4223-944d-460eba40fe8c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:26.783133 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a1a25916-56f9-4223-944d-460eba40fe8c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:26.783862 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a1a25916-56f9-4223-944d-460eba40fe8c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:26.784041 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-268954f2-41e1-4423-950b-ff1a763bf40e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:26.784313 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a1a25916-56f9-4223-944d-460eba40fe8c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:26.784566 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-268954f2-41e1-4423-950b-ff1a763bf40e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:26.784760 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a1a25916-56f9-4223-944d-460eba40fe8c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:26.785005 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-268954f2-41e1-4423-950b-ff1a763bf40e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:26.785700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-268954f2-41e1-4423-950b-ff1a763bf40e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:26.786155 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-268954f2-41e1-4423-950b-ff1a763bf40e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:26.786584 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-268954f2-41e1-4423-950b-ff1a763bf40e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:26.976189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a1a25916-56f9-4223-944d-460eba40fe8c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:26.979030 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-268954f2-41e1-4423-950b-ff1a763bf40e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:26.984788 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a1a25916-56f9-4223-944d-460eba40fe8c tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1688 microversion: 2.1 time: 0.213515 Oct 14 03:12:26.985366 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 378/734] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:26 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1688 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:26.987102 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-268954f2-41e1-4423-950b-ff1a763bf40e tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1679 microversion: 2.1 time: 0.214499 Oct 14 03:12:26.987667 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 357/735] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:26 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:27.259723 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-caa4c8ca-72b0-4353-81d4-e3e49361348e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:27.260260 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-caa4c8ca-72b0-4353-81d4-e3e49361348e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:27.266169 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-caa4c8ca-72b0-4353-81d4-e3e49361348e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:27.266652 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-caa4c8ca-72b0-4353-81d4-e3e49361348e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:27.267088 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-caa4c8ca-72b0-4353-81d4-e3e49361348e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:27.267784 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-caa4c8ca-72b0-4353-81d4-e3e49361348e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:27.268237 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-caa4c8ca-72b0-4353-81d4-e3e49361348e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:27.268695 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-caa4c8ca-72b0-4353-81d4-e3e49361348e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:27.399844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-caa4c8ca-72b0-4353-81d4-e3e49361348e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:27.408113 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-caa4c8ca-72b0-4353-81d4-e3e49361348e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1361 microversion: 2.1 time: 0.152261 Oct 14 03:12:27.410110 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 379/736] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:27 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:28.007890 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d006f004-f86c-4706-b8d2-fc35729b5bb9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:28.008478 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d006f004-f86c-4706-b8d2-fc35729b5bb9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:28.010428 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-2650bdde-05aa-4805-bca6-8159e3efb9a7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:28.011061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-2650bdde-05aa-4805-bca6-8159e3efb9a7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:28.014934 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d006f004-f86c-4706-b8d2-fc35729b5bb9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:28.015498 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d006f004-f86c-4706-b8d2-fc35729b5bb9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:28.016504 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d006f004-f86c-4706-b8d2-fc35729b5bb9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:28.017211 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d006f004-f86c-4706-b8d2-fc35729b5bb9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:28.017671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d006f004-f86c-4706-b8d2-fc35729b5bb9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:28.017938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2650bdde-05aa-4805-bca6-8159e3efb9a7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:28.018103 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d006f004-f86c-4706-b8d2-fc35729b5bb9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:28.018419 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2650bdde-05aa-4805-bca6-8159e3efb9a7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:28.018851 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2650bdde-05aa-4805-bca6-8159e3efb9a7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:28.019536 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2650bdde-05aa-4805-bca6-8159e3efb9a7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:28.019982 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2650bdde-05aa-4805-bca6-8159e3efb9a7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:28.020415 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2650bdde-05aa-4805-bca6-8159e3efb9a7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:28.211214 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-d006f004-f86c-4706-b8d2-fc35729b5bb9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:28.214283 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-2650bdde-05aa-4805-bca6-8159e3efb9a7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:28.219559 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d006f004-f86c-4706-b8d2-fc35729b5bb9 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1688 microversion: 2.1 time: 0.215710 Oct 14 03:12:28.220359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 358/737] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:28 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1688 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:28.227329 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-2650bdde-05aa-4805-bca6-8159e3efb9a7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1679 microversion: 2.1 time: 0.220670 Oct 14 03:12:28.228052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 380/738] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:28 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:28.430783 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-cd210b8a-c04f-4ee4-ae88-1660ec1c6058 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:28.431397 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-cd210b8a-c04f-4ee4-ae88-1660ec1c6058 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:28.437291 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cd210b8a-c04f-4ee4-ae88-1660ec1c6058 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:28.438362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cd210b8a-c04f-4ee4-ae88-1660ec1c6058 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:28.438800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cd210b8a-c04f-4ee4-ae88-1660ec1c6058 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:28.439495 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cd210b8a-c04f-4ee4-ae88-1660ec1c6058 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:28.439952 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cd210b8a-c04f-4ee4-ae88-1660ec1c6058 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:28.440377 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cd210b8a-c04f-4ee4-ae88-1660ec1c6058 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:28.575293 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-cd210b8a-c04f-4ee4-ae88-1660ec1c6058 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:28.584337 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-cd210b8a-c04f-4ee4-ae88-1660ec1c6058 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1361 microversion: 2.1 time: 0.156070 Oct 14 03:12:28.585552 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 359/739] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:28 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:29.243223 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fd3418ba-d374-4647-8b2c-24e798832e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:29.243735 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fd3418ba-d374-4647-8b2c-24e798832e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:29.250985 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fd3418ba-d374-4647-8b2c-24e798832e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:29.251421 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-eb52f030-474a-45e4-975a-48a070c22edc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:29.251829 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fd3418ba-d374-4647-8b2c-24e798832e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:29.251941 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fd3418ba-d374-4647-8b2c-24e798832e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:29.252160 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-eb52f030-474a-45e4-975a-48a070c22edc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:29.252631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fd3418ba-d374-4647-8b2c-24e798832e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:29.253086 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fd3418ba-d374-4647-8b2c-24e798832e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:29.253506 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fd3418ba-d374-4647-8b2c-24e798832e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:29.258623 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-eb52f030-474a-45e4-975a-48a070c22edc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:29.259102 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-eb52f030-474a-45e4-975a-48a070c22edc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:29.259538 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-eb52f030-474a-45e4-975a-48a070c22edc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:29.260231 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-eb52f030-474a-45e4-975a-48a070c22edc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:29.260715 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-eb52f030-474a-45e4-975a-48a070c22edc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:29.261141 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-eb52f030-474a-45e4-975a-48a070c22edc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:29.444192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fd3418ba-d374-4647-8b2c-24e798832e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:29.447413 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-eb52f030-474a-45e4-975a-48a070c22edc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:29.447673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:29.452357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fd3418ba-d374-4647-8b2c-24e798832e5a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1688 microversion: 2.1 time: 0.213399 Oct 14 03:12:29.460579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 381/740] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:29 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1688 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:29.460698 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-eb52f030-474a-45e4-975a-48a070c22edc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1679 microversion: 2.1 time: 0.208930 Oct 14 03:12:29.460698 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 360/741] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:29 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:29.608714 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3386ab96-3d42-425e-8608-a9ae9fd31739 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:29.609594 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3386ab96-3d42-425e-8608-a9ae9fd31739 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:29.617360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3386ab96-3d42-425e-8608-a9ae9fd31739 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:29.617966 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3386ab96-3d42-425e-8608-a9ae9fd31739 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:29.618524 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3386ab96-3d42-425e-8608-a9ae9fd31739 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:29.619488 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3386ab96-3d42-425e-8608-a9ae9fd31739 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:29.620047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3386ab96-3d42-425e-8608-a9ae9fd31739 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:29.620611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3386ab96-3d42-425e-8608-a9ae9fd31739 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:29.761142 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3386ab96-3d42-425e-8608-a9ae9fd31739 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:29.769425 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3386ab96-3d42-425e-8608-a9ae9fd31739 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1361 microversion: 2.1 time: 0.164576 Oct 14 03:12:29.778177 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 382/742] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:29 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:30.237862 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-95fe1556-a2ae-40f8-b352-d55126a6bddb req-af8cf8a6-7e2d-46cc-af47-52e1364d14be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3200a8b9-6447-41fb-8433-36b0283813ee", "name": "network-vif-unplugged", "status": "completed", "tag": "54331d2d-aa76-4594-90ce-8cefce821aa5"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:30.248489 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-95fe1556-a2ae-40f8-b352-d55126a6bddb req-af8cf8a6-7e2d-46cc-af47-52e1364d14be service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:30.249077 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-95fe1556-a2ae-40f8-b352-d55126a6bddb req-af8cf8a6-7e2d-46cc-af47-52e1364d14be service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:30.249571 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-95fe1556-a2ae-40f8-b352-d55126a6bddb req-af8cf8a6-7e2d-46cc-af47-52e1364d14be service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:30.261657 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-95fe1556-a2ae-40f8-b352-d55126a6bddb req-af8cf8a6-7e2d-46cc-af47-52e1364d14be service nova] Creating event network-vif-unplugged:54331d2d-aa76-4594-90ce-8cefce821aa5 for instance 3200a8b9-6447-41fb-8433-36b0283813ee on hv-cinder-80152 Oct 14 03:12:30.267069 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-95fe1556-a2ae-40f8-b352-d55126a6bddb req-af8cf8a6-7e2d-46cc-af47-52e1364d14be service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034719 Oct 14 03:12:30.267871 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 361/743] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:30.476807 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-6de35d34-8991-4809-b75b-db2ee8551870 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:30.477536 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-6de35d34-8991-4809-b75b-db2ee8551870 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:30.480123 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2b9d4147-703c-4be4-84d1-d20917301d41 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:30.480870 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2b9d4147-703c-4be4-84d1-d20917301d41 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:30.485447 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6de35d34-8991-4809-b75b-db2ee8551870 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:30.485939 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6de35d34-8991-4809-b75b-db2ee8551870 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:30.486376 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6de35d34-8991-4809-b75b-db2ee8551870 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:30.487202 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6de35d34-8991-4809-b75b-db2ee8551870 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:30.487657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6de35d34-8991-4809-b75b-db2ee8551870 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:30.489742 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6de35d34-8991-4809-b75b-db2ee8551870 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:30.489847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2b9d4147-703c-4be4-84d1-d20917301d41 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:30.489847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2b9d4147-703c-4be4-84d1-d20917301d41 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:30.489847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2b9d4147-703c-4be4-84d1-d20917301d41 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:30.490591 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2b9d4147-703c-4be4-84d1-d20917301d41 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:30.491070 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2b9d4147-703c-4be4-84d1-d20917301d41 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:30.491648 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2b9d4147-703c-4be4-84d1-d20917301d41 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:30.691572 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-6de35d34-8991-4809-b75b-db2ee8551870 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:30.693953 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2b9d4147-703c-4be4-84d1-d20917301d41 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:30.699351 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-6de35d34-8991-4809-b75b-db2ee8551870 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1688 microversion: 2.1 time: 0.226508 Oct 14 03:12:30.699925 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 383/744] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:30 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1688 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:30.703157 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2b9d4147-703c-4be4-84d1-d20917301d41 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1679 microversion: 2.1 time: 0.227787 Oct 14 03:12:30.704494 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 362/745] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:30 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:30.762406 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-b5e83b79-067f-49b9-8edd-ae3ebc4d8b69 req-73232f5c-6f57-4590-8e31-e67325565810 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "fd1db9a1-d651-4fab-8c77-36ed1a234674", "create_info": {"type": "qcow2", "new_file": "volume-fd1db9a1-d651-4fab-8c77-36ed1a234674.23ff9b97-d632-4ccb-a304-8d4f9eb76643.vhdx", "snapshot_id": "23ff9b97-d632-4ccb-a304-8d4f9eb76643"}}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:30.765776 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-b5e83b79-067f-49b9-8edd-ae3ebc4d8b69 req-73232f5c-6f57-4590-8e31-e67325565810 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:30.767076 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-b5e83b79-067f-49b9-8edd-ae3ebc4d8b69 req-73232f5c-6f57-4590-8e31-e67325565810 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:30.767709 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-b5e83b79-067f-49b9-8edd-ae3ebc4d8b69 req-73232f5c-6f57-4590-8e31-e67325565810 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:30.775995 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-b5e83b79-067f-49b9-8edd-ae3ebc4d8b69 req-73232f5c-6f57-4590-8e31-e67325565810 admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:30.776527 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-b5e83b79-067f-49b9-8edd-ae3ebc4d8b69 req-73232f5c-6f57-4590-8e31-e67325565810 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:30.780879 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-b5e83b79-067f-49b9-8edd-ae3ebc4d8b69 req-73232f5c-6f57-4590-8e31-e67325565810 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:30.791404 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-b5e83b79-067f-49b9-8edd-ae3ebc4d8b69 req-73232f5c-6f57-4590-8e31-e67325565810 admin admin] 10.222.0.44 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.089132 Oct 14 03:12:30.791934 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 384/746] 10.222.0.44 () {64 vars in 1326 bytes} [Fri Oct 14 03:12:30 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:12:30.792478 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-5e4feb20-d9b7-44f3-9d3e-f0d20973463d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:30.793169 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-5e4feb20-d9b7-44f3-9d3e-f0d20973463d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:30.799362 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5e4feb20-d9b7-44f3-9d3e-f0d20973463d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:30.799843 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5e4feb20-d9b7-44f3-9d3e-f0d20973463d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:30.800278 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5e4feb20-d9b7-44f3-9d3e-f0d20973463d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:30.800993 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5e4feb20-d9b7-44f3-9d3e-f0d20973463d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:30.801476 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5e4feb20-d9b7-44f3-9d3e-f0d20973463d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:30.801892 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5e4feb20-d9b7-44f3-9d3e-f0d20973463d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:30.942743 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5e4feb20-d9b7-44f3-9d3e-f0d20973463d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:30.950833 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-5e4feb20-d9b7-44f3-9d3e-f0d20973463d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1361 microversion: 2.1 time: 0.163407 Oct 14 03:12:30.951760 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 363/747] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:30 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:31.587782 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-f3a83b61-8ff4-4f0f-bc1f-98333f026978 req-9d29f945-4426-43f5-932c-153920e30c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ae6b50-1d01-420e-ab83-6c856e0b35d4", "name": "network-vif-deleted", "tag": "f66ba8f5-3869-4069-a4dc-7c7a64eb44d9"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:31.609379 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-f3a83b61-8ff4-4f0f-bc1f-98333f026978 req-9d29f945-4426-43f5-932c-153920e30c94 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:31.610234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-f3a83b61-8ff4-4f0f-bc1f-98333f026978 req-9d29f945-4426-43f5-932c-153920e30c94 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:31.611520 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-f3a83b61-8ff4-4f0f-bc1f-98333f026978 req-9d29f945-4426-43f5-932c-153920e30c94 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:31.637152 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-f3a83b61-8ff4-4f0f-bc1f-98333f026978 req-9d29f945-4426-43f5-932c-153920e30c94 service nova] Creating event network-vif-deleted:f66ba8f5-3869-4069-a4dc-7c7a64eb44d9 for instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 on hv-cinder-80152 Oct 14 03:12:31.643851 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-f3a83b61-8ff4-4f0f-bc1f-98333f026978 req-9d29f945-4426-43f5-932c-153920e30c94 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062619 Oct 14 03:12:31.646048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 385/748] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:31.726972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-7f29b4fc-daf6-4cae-8f76-fbdd2ad2153d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:31.727660 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-7f29b4fc-daf6-4cae-8f76-fbdd2ad2153d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:31.728757 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3c0a0f44-13d5-40b7-88a3-ed812e57b897 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:31.729688 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3c0a0f44-13d5-40b7-88a3-ed812e57b897 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:31.734616 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7f29b4fc-daf6-4cae-8f76-fbdd2ad2153d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:31.735233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7f29b4fc-daf6-4cae-8f76-fbdd2ad2153d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:31.736535 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7f29b4fc-daf6-4cae-8f76-fbdd2ad2153d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:31.737446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3c0a0f44-13d5-40b7-88a3-ed812e57b897 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:31.737573 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7f29b4fc-daf6-4cae-8f76-fbdd2ad2153d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:31.738032 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7f29b4fc-daf6-4cae-8f76-fbdd2ad2153d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:31.738389 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3c0a0f44-13d5-40b7-88a3-ed812e57b897 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:31.738774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7f29b4fc-daf6-4cae-8f76-fbdd2ad2153d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:31.739134 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3c0a0f44-13d5-40b7-88a3-ed812e57b897 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:31.740230 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3c0a0f44-13d5-40b7-88a3-ed812e57b897 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:31.740889 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3c0a0f44-13d5-40b7-88a3-ed812e57b897 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:31.741544 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3c0a0f44-13d5-40b7-88a3-ed812e57b897 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:31.836616 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3c0a0f44-13d5-40b7-88a3-ed812e57b897 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:31.847943 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3c0a0f44-13d5-40b7-88a3-ed812e57b897 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1612 microversion: 2.1 time: 0.123319 Oct 14 03:12:31.851566 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 386/749] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:31 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1612 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:31.973961 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7f29b4fc-daf6-4cae-8f76-fbdd2ad2153d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:31.978132 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fb3a83c9-9a8c-440a-be86-aa6589dbde45 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:31.978738 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fb3a83c9-9a8c-440a-be86-aa6589dbde45 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:31.988527 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-7f29b4fc-daf6-4cae-8f76-fbdd2ad2153d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1621 microversion: 2.1 time: 0.269092 Oct 14 03:12:31.993091 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 364/750] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:31 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1621 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:31.994101 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fb3a83c9-9a8c-440a-be86-aa6589dbde45 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:31.999882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fb3a83c9-9a8c-440a-be86-aa6589dbde45 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:31.999882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fb3a83c9-9a8c-440a-be86-aa6589dbde45 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:31.999882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fb3a83c9-9a8c-440a-be86-aa6589dbde45 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:31.999882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fb3a83c9-9a8c-440a-be86-aa6589dbde45 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:32.000368 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fb3a83c9-9a8c-440a-be86-aa6589dbde45 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:32.145705 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fb3a83c9-9a8c-440a-be86-aa6589dbde45 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:32.155189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fb3a83c9-9a8c-440a-be86-aa6589dbde45 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1547 microversion: 2.1 time: 0.183928 Oct 14 03:12:32.156448 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 387/751] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:31 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1547 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:32.178570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-68197227-782f-42ce-bfff-1677584b2f7a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:32.179343 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-68197227-782f-42ce-bfff-1677584b2f7a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:32.185878 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-68197227-782f-42ce-bfff-1677584b2f7a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:32.186371 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-68197227-782f-42ce-bfff-1677584b2f7a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:32.186808 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-68197227-782f-42ce-bfff-1677584b2f7a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:32.187713 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-68197227-782f-42ce-bfff-1677584b2f7a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:32.188653 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-68197227-782f-42ce-bfff-1677584b2f7a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:32.188996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-68197227-782f-42ce-bfff-1677584b2f7a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:32.284347 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-68197227-782f-42ce-bfff-1677584b2f7a tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109833 Oct 14 03:12:32.285381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 365/752] 10.222.0.13 () {58 vars in 1275 bytes} [Fri Oct 14 03:12:32 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:32.877017 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5ca84c6f-4eec-4416-ab75-b439ac576abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:32.877602 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5ca84c6f-4eec-4416-ab75-b439ac576abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:32.884344 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ca84c6f-4eec-4416-ab75-b439ac576abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:32.885227 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ca84c6f-4eec-4416-ab75-b439ac576abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:32.885939 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ca84c6f-4eec-4416-ab75-b439ac576abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:32.886902 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ca84c6f-4eec-4416-ab75-b439ac576abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:32.887542 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ca84c6f-4eec-4416-ab75-b439ac576abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:32.888156 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ca84c6f-4eec-4416-ab75-b439ac576abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:32.922940 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ca84c6f-4eec-4416-ab75-b439ac576abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:32.923561 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ca84c6f-4eec-4416-ab75-b439ac576abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:32.924080 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ca84c6f-4eec-4416-ab75-b439ac576abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:32.924781 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-5ca84c6f-4eec-4416-ab75-b439ac576abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lazy-loading 'fault' on Instance uuid 3200a8b9-6447-41fb-8433-36b0283813ee {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:32.969818 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5ca84c6f-4eec-4416-ab75-b439ac576abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:32.978168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5ca84c6f-4eec-4416-ab75-b439ac576abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1330 microversion: 2.1 time: 0.105150 Oct 14 03:12:32.978751 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 388/753] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:32 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:33.018415 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-28321a5c-bdd0-453c-948b-6c8498ea4a7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:33.019117 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-28321a5c-bdd0-453c-948b-6c8498ea4a7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:33.025319 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28321a5c-bdd0-453c-948b-6c8498ea4a7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:33.025924 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28321a5c-bdd0-453c-948b-6c8498ea4a7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:33.026399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28321a5c-bdd0-453c-948b-6c8498ea4a7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:33.027100 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28321a5c-bdd0-453c-948b-6c8498ea4a7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:33.027556 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28321a5c-bdd0-453c-948b-6c8498ea4a7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:33.028010 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28321a5c-bdd0-453c-948b-6c8498ea4a7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:33.058560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28321a5c-bdd0-453c-948b-6c8498ea4a7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:33.059045 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28321a5c-bdd0-453c-948b-6c8498ea4a7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:33.059523 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-28321a5c-bdd0-453c-948b-6c8498ea4a7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:33.059972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-28321a5c-bdd0-453c-948b-6c8498ea4a7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lazy-loading 'fault' on Instance uuid a2ae6b50-1d01-420e-ab83-6c856e0b35d4 {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:33.102488 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-28321a5c-bdd0-453c-948b-6c8498ea4a7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:33.111244 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-28321a5c-bdd0-453c-948b-6c8498ea4a7e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1335 microversion: 2.1 time: 0.097728 Oct 14 03:12:33.112562 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 366/754] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:33 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1335 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:33.661092 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-641a3501-8265-4491-bdb5-6ff1e62da238 req-3d8f6733-d7d3-4958-b684-4570df80ae8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3200a8b9-6447-41fb-8433-36b0283813ee", "name": "network-vif-deleted", "tag": "54331d2d-aa76-4594-90ce-8cefce821aa5"}, {"name": "network-changed", "server_uuid": "1ce9443a-d60b-446c-84b0-3620d5233c37", "tag": "6e93d958-2f8f-469a-b768-aa7ead1d26b0"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:33.672456 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-641a3501-8265-4491-bdb5-6ff1e62da238 req-3d8f6733-d7d3-4958-b684-4570df80ae8d service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:33.672944 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-641a3501-8265-4491-bdb5-6ff1e62da238 req-3d8f6733-d7d3-4958-b684-4570df80ae8d service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:33.674220 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-641a3501-8265-4491-bdb5-6ff1e62da238 req-3d8f6733-d7d3-4958-b684-4570df80ae8d service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:33.689937 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-641a3501-8265-4491-bdb5-6ff1e62da238 req-3d8f6733-d7d3-4958-b684-4570df80ae8d service nova] Creating event network-vif-deleted:54331d2d-aa76-4594-90ce-8cefce821aa5 for instance 3200a8b9-6447-41fb-8433-36b0283813ee on hv-cinder-80152 Oct 14 03:12:33.690502 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-641a3501-8265-4491-bdb5-6ff1e62da238 req-3d8f6733-d7d3-4958-b684-4570df80ae8d service nova] Creating event network-changed:6e93d958-2f8f-469a-b768-aa7ead1d26b0 for instance 1ce9443a-d60b-446c-84b0-3620d5233c37 on hv-cinder-80152 Oct 14 03:12:33.696967 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-641a3501-8265-4491-bdb5-6ff1e62da238 req-3d8f6733-d7d3-4958-b684-4570df80ae8d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040002 Oct 14 03:12:33.697565 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 389/755] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:34.002260 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8263f6ac-b4cc-45d4-8ebf-8f9be226989c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:34.003649 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8263f6ac-b4cc-45d4-8ebf-8f9be226989c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:34.009746 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8263f6ac-b4cc-45d4-8ebf-8f9be226989c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:34.010231 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8263f6ac-b4cc-45d4-8ebf-8f9be226989c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:34.010663 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8263f6ac-b4cc-45d4-8ebf-8f9be226989c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:34.011357 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8263f6ac-b4cc-45d4-8ebf-8f9be226989c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:34.011817 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8263f6ac-b4cc-45d4-8ebf-8f9be226989c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:34.012243 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8263f6ac-b4cc-45d4-8ebf-8f9be226989c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:34.052645 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8263f6ac-b4cc-45d4-8ebf-8f9be226989c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:34.053305 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8263f6ac-b4cc-45d4-8ebf-8f9be226989c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:34.053559 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8263f6ac-b4cc-45d4-8ebf-8f9be226989c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:34.054425 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-8263f6ac-b4cc-45d4-8ebf-8f9be226989c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lazy-loading 'fault' on Instance uuid 3200a8b9-6447-41fb-8433-36b0283813ee {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:34.095259 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8263f6ac-b4cc-45d4-8ebf-8f9be226989c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:34.098424 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:34.110774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8263f6ac-b4cc-45d4-8ebf-8f9be226989c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 200 len: 1330 microversion: 2.1 time: 0.112407 Oct 14 03:12:34.112204 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 367/756] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:33 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:34.138347 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-77305fe3-b177-4012-af12-208443281241 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:34.139116 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-77305fe3-b177-4012-af12-208443281241 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:34.146532 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77305fe3-b177-4012-af12-208443281241 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:34.147130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77305fe3-b177-4012-af12-208443281241 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:34.149664 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77305fe3-b177-4012-af12-208443281241 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:34.150654 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77305fe3-b177-4012-af12-208443281241 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:34.154248 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77305fe3-b177-4012-af12-208443281241 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:34.154248 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77305fe3-b177-4012-af12-208443281241 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:34.199697 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77305fe3-b177-4012-af12-208443281241 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:34.200316 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77305fe3-b177-4012-af12-208443281241 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:34.200774 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77305fe3-b177-4012-af12-208443281241 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:34.201223 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-77305fe3-b177-4012-af12-208443281241 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lazy-loading 'fault' on Instance uuid a2ae6b50-1d01-420e-ab83-6c856e0b35d4 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:34.309356 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-77305fe3-b177-4012-af12-208443281241 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:34.319231 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-77305fe3-b177-4012-af12-208443281241 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 200 len: 1335 microversion: 2.1 time: 0.185263 Oct 14 03:12:34.350137 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 390/757] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:34 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 1335 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:35.134686 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e949ad03-6ef4-4792-b628-3f6967e12bf7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:35.135310 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e949ad03-6ef4-4792-b628-3f6967e12bf7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:35.142466 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e949ad03-6ef4-4792-b628-3f6967e12bf7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:35.142956 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e949ad03-6ef4-4792-b628-3f6967e12bf7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:35.143378 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e949ad03-6ef4-4792-b628-3f6967e12bf7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:35.144066 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e949ad03-6ef4-4792-b628-3f6967e12bf7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:35.144546 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e949ad03-6ef4-4792-b628-3f6967e12bf7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:35.144969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e949ad03-6ef4-4792-b628-3f6967e12bf7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:35.158064 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-e949ad03-6ef4-4792-b628-3f6967e12bf7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] HTTP exception thrown: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e949ad03-6ef4-4792-b628-3f6967e12bf7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Request method failure captured: Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee HTTP/1.1 Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKG-ky05sope_YdGjGweAljK5FUxzsY0TE3JqS7jM4jPzALKbCEnItlHGzo5Xg-IOfB8MCgv3mdaVNqvdBnmYZMENHyFWRo7_9tNs76BHsJnl6Osbo5VySDApF7HiliGWSEh0OSOTvdEIMsVWp5oVBM2GccEYCsyuR5X3gKYrX8g9g Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:12:35.159626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:12:35.161233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:12:35.161233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:12:35.161233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:12:35.161233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:12:35.161233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:12:35.161233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:12:35.161233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:12:35.161233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 4553b7573ca34af6a9fdb94f80717f24 Oct 14 03:12:35.161233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:12:35.161233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:12:35.161233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:12:35.161233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': '3200a8b9-6447-41fb-8433-36b0283813ee'} Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:12:35.162121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:12:35.163678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:12:35.165320 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e949ad03-6ef4-4792-b628-3f6967e12bf7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Returning 404 to user: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:12:35.165320 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e949ad03-6ef4-4792-b628-3f6967e12bf7 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 404 len: 111 microversion: 2.1 time: 0.030283 Oct 14 03:12:35.165320 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 368/758] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:35 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:12:35.170209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-18182d6b-6685-4e52-b5d8-aa1e974a3053 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '.version_select at 0x7fdcc75509d0>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:35.241334 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-18182d6b-6685-4e52-b5d8-aa1e974a3053 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-489287594" status: 202 len: 0 microversion: 2.1 time: 0.074834 Oct 14 03:12:35.241915 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 391/759] 10.222.0.13 () {58 vars in 1218 bytes} [Fri Oct 14 03:12:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-489287594 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:12:35.313077 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-1aa471c7-4a6d-4770-9fb3-faf14cd08672 req-98f625bc-39f4-4163-8f04-fd5f05ba5895 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "fd1db9a1-d651-4fab-8c77-36ed1a234674", "create_info": {"type": "qcow2", "new_file": "volume-fd1db9a1-d651-4fab-8c77-36ed1a234674.99d23c89-11e3-4a09-ac31-191ed18407b0.vhdx", "snapshot_id": "99d23c89-11e3-4a09-ac31-191ed18407b0"}}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:35.316605 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-1aa471c7-4a6d-4770-9fb3-faf14cd08672 req-98f625bc-39f4-4163-8f04-fd5f05ba5895 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:35.317199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-1aa471c7-4a6d-4770-9fb3-faf14cd08672 req-98f625bc-39f4-4163-8f04-fd5f05ba5895 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:35.317702 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-1aa471c7-4a6d-4770-9fb3-faf14cd08672 req-98f625bc-39f4-4163-8f04-fd5f05ba5895 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:35.326047 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-1aa471c7-4a6d-4770-9fb3-faf14cd08672 req-98f625bc-39f4-4163-8f04-fd5f05ba5895 admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:35.326598 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-1aa471c7-4a6d-4770-9fb3-faf14cd08672 req-98f625bc-39f4-4163-8f04-fd5f05ba5895 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:35.327102 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-1aa471c7-4a6d-4770-9fb3-faf14cd08672 req-98f625bc-39f4-4163-8f04-fd5f05ba5895 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:35.341442 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-1aa471c7-4a6d-4770-9fb3-faf14cd08672 req-98f625bc-39f4-4163-8f04-fd5f05ba5895 admin admin] 10.222.0.44 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.079782 Oct 14 03:12:35.342180 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 369/760] 10.222.0.44 () {64 vars in 1326 bytes} [Fri Oct 14 03:12:35 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:12:35.364249 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-175cd431-ec79-4e11-aa3c-09a5ec4e97a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:35.364893 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-175cd431-ec79-4e11-aa3c-09a5ec4e97a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: a2ae6b50-1d01-420e-ab83-6c856e0b35d4] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:35.372544 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-175cd431-ec79-4e11-aa3c-09a5ec4e97a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:35.373436 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-175cd431-ec79-4e11-aa3c-09a5ec4e97a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:35.374534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-175cd431-ec79-4e11-aa3c-09a5ec4e97a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:35.375836 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-175cd431-ec79-4e11-aa3c-09a5ec4e97a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:35.376719 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-175cd431-ec79-4e11-aa3c-09a5ec4e97a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:35.377497 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-175cd431-ec79-4e11-aa3c-09a5ec4e97a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:35.392784 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-175cd431-ec79-4e11-aa3c-09a5ec4e97a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] HTTP exception thrown: Instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 could not be found. Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-175cd431-ec79-4e11-aa3c-09a5ec4e97a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Request method failure captured: Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 HTTP/1.1 Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNKH4NxEPMl2MiNB1XCe-xt7krq1NrhiwWzh8PUcUNc7DPMToyK61BYEVmqnH8PcIjU4NdaDSCKUk9p7hizeKHSG12vRmixqmA6Av241GRS3ISj8jYf2FW8S0N5rYB7-2yQkL3Hn58t-PG07p68TryoPL80eVR0qFpm0wcS-Fmdl0QQ Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 61f89b8e68d14d3d96fa84ab1697fcea Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:12:35.394475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:12:35.396048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:12:35.396048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:12:35.396048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 61f89b8e68d14d3d96fa84ab1697fcea Oct 14 03:12:35.396048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:12:35.396048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-ServerRescueNegativeTestJSON-883339385-project Oct 14 03:12:35.396048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:12:35.396048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:12:35.396048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: dbf0723a0f3942d2b9b2554320878016 Oct 14 03:12:35.396048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-ServerRescueNegativeTestJSON-883339385-project Oct 14 03:12:35.396048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:12:35.396048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 could not be found. Oct 14 03:12:35.396048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': 'a2ae6b50-1d01-420e-ab83-6c856e0b35d4'} Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 could not be found. Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:12:35.396950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 could not be found. Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 could not be found. Oct 14 03:12:35.398486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:35.399757 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-175cd431-ec79-4e11-aa3c-09a5ec4e97a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Returning 404 to user: Instance a2ae6b50-1d01-420e-ab83-6c856e0b35d4 could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:12:35.399757 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-175cd431-ec79-4e11-aa3c-09a5ec4e97a3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4" status: 404 len: 111 microversion: 2.1 time: 0.036195 Oct 14 03:12:35.399757 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 392/761] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:35 2022] GET /compute/v2.1/servers/a2ae6b50-1d01-420e-ab83-6c856e0b35d4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:12:35.405324 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b9676e51-dd71-4b00-a9a7-a68fba9b0b92 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '.version_select at 0x7fdcc7488e50>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:35.475220 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b9676e51-dd71-4b00-a9a7-a68fba9b0b92 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-908666610" status: 202 len: 0 microversion: 2.1 time: 0.074089 Oct 14 03:12:35.476037 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 370/762] 10.222.0.13 () {58 vars in 1218 bytes} [Fri Oct 14 03:12:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-908666610 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:12:36.052090 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-23e1e6dc-2335-4c96-8875-e75f1ba80fe5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Action: 'create', calling method: .version_select at 0x7fdcc7541ca0>, body: {"keypair": {"name": "tempest-keypair-1848355125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhUdze5L8EomksQ4ahjsd2OPS9sbYqqL/z8KM1k9WzgeavetxFVvyUY5v9E1sHaUY5lVCdmxIX03GoVCZsatGgn1Q7tpC3LDF7aSqT3WpnaQrKkZe4QCRFU6GFqHfHLzg=="}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:36.067786 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-23e1e6dc-2335-4c96-8875-e75f1ba80fe5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:12:36.072052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-23e1e6dc-2335-4c96-8875-e75f1ba80fe5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for user 4553b7573ca34af6a9fdb94f80717f24 and project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:12:36.178460 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-23e1e6dc-2335-4c96-8875-e75f1ba80fe5 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130226 Oct 14 03:12:36.179072 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 393/763] 10.222.0.13 () {60 vars in 1159 bytes} [Fri Oct 14 03:12:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:38.319088 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-615462075", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fcf48d6-7187-4929-b5fb-8bc693b44fb9"}], "security_groups": [{"name": "tempest-securitygroup--576021066"}], "key_name": "tempest-keypair-1848355125", "user_data": "}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:38.424240 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.network.neutron [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] validate_networks() for [('9fcf48d6-7187-4929-b5fb-8bc693b44fb9', None, None, None, None, None)] {{(pid=119302) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:12:38.790661 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Flavor limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:12:38.791088 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Image limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:12:38.791614 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Flavor pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:12:38.792025 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Image pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:12:38.792461 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:12:38.801620 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:38.802103 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:38.802537 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:38.803266 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:38.803716 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:38.804142 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:38.820967 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:12:38.824992 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Getting quotas for user 4553b7573ca34af6a9fdb94f80717f24 and project 480aef72b62f45e09f59cfa48ba9a854. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:12:38.835906 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Going to run 1 instances... {{(pid=119302) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:12:38.838356 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:12:39.015256 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2efcbc08-7e17-43a9-8c20-8b663139ff0a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.700927 Oct 14 03:12:39.015908 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 371/764] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:12:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:12:39.027388 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c9697b1b-e24c-4ec9-bd84-dd1e00230a06 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:39.028033 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c9697b1b-e24c-4ec9-bd84-dd1e00230a06 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:39.089047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c9697b1b-e24c-4ec9-bd84-dd1e00230a06 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:39.096870 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c9697b1b-e24c-4ec9-bd84-dd1e00230a06 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1241 microversion: 2.1 time: 0.073809 Oct 14 03:12:39.097928 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 394/765] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:39 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:39.197563 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c9cc9dae-04d1-48f9-89da-9ba1753e0c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:39.198155 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c9cc9dae-04d1-48f9-89da-9ba1753e0c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:39.204261 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c9cc9dae-04d1-48f9-89da-9ba1753e0c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:39.204970 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c9cc9dae-04d1-48f9-89da-9ba1753e0c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:39.205475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c9cc9dae-04d1-48f9-89da-9ba1753e0c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:39.206229 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c9cc9dae-04d1-48f9-89da-9ba1753e0c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:39.206902 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c9cc9dae-04d1-48f9-89da-9ba1753e0c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:39.207325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c9cc9dae-04d1-48f9-89da-9ba1753e0c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:39.234065 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c9cc9dae-04d1-48f9-89da-9ba1753e0c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Going to try to terminate instance {{(pid=119301) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:12:39.241385 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-f1ba9148-8872-479a-9f09-bec0f0c33a4a req-01437dbc-bfa5-4429-ba10-aae03468a90a admin admin] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:39.245003 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-f1ba9148-8872-479a-9f09-bec0f0c33a4a req-01437dbc-bfa5-4429-ba10-aae03468a90a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:39.245483 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-f1ba9148-8872-479a-9f09-bec0f0c33a4a req-01437dbc-bfa5-4429-ba10-aae03468a90a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:39.245911 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-f1ba9148-8872-479a-9f09-bec0f0c33a4a req-01437dbc-bfa5-4429-ba10-aae03468a90a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:39.254802 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-f1ba9148-8872-479a-9f09-bec0f0c33a4a req-01437dbc-bfa5-4429-ba10-aae03468a90a admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:39.255273 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-f1ba9148-8872-479a-9f09-bec0f0c33a4a req-01437dbc-bfa5-4429-ba10-aae03468a90a admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:39.255703 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-f1ba9148-8872-479a-9f09-bec0f0c33a4a req-01437dbc-bfa5-4429-ba10-aae03468a90a admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:39.268577 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-f1ba9148-8872-479a-9f09-bec0f0c33a4a req-01437dbc-bfa5-4429-ba10-aae03468a90a admin admin] 10.222.0.44 "DELETE /compute/v2.1/os-assisted-volume-snapshots/99d23c89-11e3-4a09-ac31-191ed18407b0?delete_info=%7B%22file_to_merge%22:%20%22volume-fd1db9a1-d651-4fab-8c77-36ed1a234674.99d23c89-11e3-4a09-ac31-191ed18407b0.vhdx%22,%20%22volume_id%22:%20%22fd1db9a1-d651-4fab-8c77-36ed1a234674%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.082588 Oct 14 03:12:39.269205 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 372/766] 10.222.0.44 () {62 vars in 1800 bytes} [Fri Oct 14 03:12:39 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/99d23c89-11e3-4a09-ac31-191ed18407b0?delete_info=%7B%22file_to_merge%22:%20%22volume-fd1db9a1-d651-4fab-8c77-36ed1a234674.99d23c89-11e3-4a09-ac31-191ed18407b0.vhdx%22,%20%22volume_id%22:%20%22fd1db9a1-d651-4fab-8c77-36ed1a234674%22%7D => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:12:39.578379 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c9cc9dae-04d1-48f9-89da-9ba1753e0c1d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 204 len: 0 microversion: 2.1 time: 0.384303 Oct 14 03:12:39.578878 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 395/767] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:12:39 2022] DELETE /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 03:12:39.588553 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f68c3481-b7b4-4e64-acf7-f13f9869fd3b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:39.589276 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f68c3481-b7b4-4e64-acf7-f13f9869fd3b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:39.595388 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f68c3481-b7b4-4e64-acf7-f13f9869fd3b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:39.595815 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f68c3481-b7b4-4e64-acf7-f13f9869fd3b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:39.596247 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f68c3481-b7b4-4e64-acf7-f13f9869fd3b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:39.596969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f68c3481-b7b4-4e64-acf7-f13f9869fd3b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:39.598007 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f68c3481-b7b4-4e64-acf7-f13f9869fd3b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:39.598432 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f68c3481-b7b4-4e64-acf7-f13f9869fd3b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:39.734240 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-f68c3481-b7b4-4e64-acf7-f13f9869fd3b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:39.741925 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f68c3481-b7b4-4e64-acf7-f13f9869fd3b tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1506 microversion: 2.1 time: 0.158145 Oct 14 03:12:39.742758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 373/768] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:39 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:40.120483 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9d9989d8-7693-416d-9cdc-584a0ea31f49 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:40.121194 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-9d9989d8-7693-416d-9cdc-584a0ea31f49 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:40.127495 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d9989d8-7693-416d-9cdc-584a0ea31f49 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:40.127982 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d9989d8-7693-416d-9cdc-584a0ea31f49 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:40.128445 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d9989d8-7693-416d-9cdc-584a0ea31f49 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:40.129168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d9989d8-7693-416d-9cdc-584a0ea31f49 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:40.129628 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d9989d8-7693-416d-9cdc-584a0ea31f49 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:40.130056 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d9989d8-7693-416d-9cdc-584a0ea31f49 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:40.191964 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-9d9989d8-7693-416d-9cdc-584a0ea31f49 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:40.199579 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9d9989d8-7693-416d-9cdc-584a0ea31f49 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1245 microversion: 2.1 time: 0.083667 Oct 14 03:12:40.201713 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 396/769] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:40 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:40.765736 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f3155de7-97dd-4ba2-9e4f-9add419215b7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:40.766358 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f3155de7-97dd-4ba2-9e4f-9add419215b7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:40.773560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3155de7-97dd-4ba2-9e4f-9add419215b7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:40.774049 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3155de7-97dd-4ba2-9e4f-9add419215b7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:40.774492 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3155de7-97dd-4ba2-9e4f-9add419215b7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:40.775191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3155de7-97dd-4ba2-9e4f-9add419215b7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:40.775649 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3155de7-97dd-4ba2-9e4f-9add419215b7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:40.776133 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3155de7-97dd-4ba2-9e4f-9add419215b7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:40.903461 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-f3155de7-97dd-4ba2-9e4f-9add419215b7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:40.911106 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f3155de7-97dd-4ba2-9e4f-9add419215b7 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1506 microversion: 2.1 time: 0.149260 Oct 14 03:12:40.911674 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 374/770] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:40 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:41.222789 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f0edc7d1-cfa6-4633-9c4f-f71eb723d05b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:41.224071 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f0edc7d1-cfa6-4633-9c4f-f71eb723d05b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:41.226050 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=2 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:41.231252 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f0edc7d1-cfa6-4633-9c4f-f71eb723d05b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:41.231729 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f0edc7d1-cfa6-4633-9c4f-f71eb723d05b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:41.232221 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f0edc7d1-cfa6-4633-9c4f-f71eb723d05b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:41.232867 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f0edc7d1-cfa6-4633-9c4f-f71eb723d05b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:41.233317 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f0edc7d1-cfa6-4633-9c4f-f71eb723d05b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:41.233738 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f0edc7d1-cfa6-4633-9c4f-f71eb723d05b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:41.294034 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f0edc7d1-cfa6-4633-9c4f-f71eb723d05b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:41.301522 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f0edc7d1-cfa6-4633-9c4f-f71eb723d05b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1237 microversion: 2.1 time: 0.082522 Oct 14 03:12:41.302084 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 397/771] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:41 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:41.934202 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-dbd61f9d-437f-4f6c-a944-9ab2c78cbafb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:41.934745 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-dbd61f9d-437f-4f6c-a944-9ab2c78cbafb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:41.941131 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dbd61f9d-437f-4f6c-a944-9ab2c78cbafb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:41.941607 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dbd61f9d-437f-4f6c-a944-9ab2c78cbafb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:41.942685 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dbd61f9d-437f-4f6c-a944-9ab2c78cbafb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:41.943380 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dbd61f9d-437f-4f6c-a944-9ab2c78cbafb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:41.943838 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dbd61f9d-437f-4f6c-a944-9ab2c78cbafb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:41.944266 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dbd61f9d-437f-4f6c-a944-9ab2c78cbafb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:42.072412 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-dbd61f9d-437f-4f6c-a944-9ab2c78cbafb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:42.080062 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-dbd61f9d-437f-4f6c-a944-9ab2c78cbafb tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1506 microversion: 2.1 time: 0.149800 Oct 14 03:12:42.080696 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 375/772] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:41 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:42.323450 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c9968619-01a9-4f44-b990-9a6353de31f8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:42.323961 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c9968619-01a9-4f44-b990-9a6353de31f8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:42.330299 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c9968619-01a9-4f44-b990-9a6353de31f8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:42.330771 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c9968619-01a9-4f44-b990-9a6353de31f8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:42.331199 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c9968619-01a9-4f44-b990-9a6353de31f8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:42.331877 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c9968619-01a9-4f44-b990-9a6353de31f8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:42.332326 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c9968619-01a9-4f44-b990-9a6353de31f8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:42.332771 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c9968619-01a9-4f44-b990-9a6353de31f8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:42.392363 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c9968619-01a9-4f44-b990-9a6353de31f8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:42.400322 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c9968619-01a9-4f44-b990-9a6353de31f8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1237 microversion: 2.1 time: 0.080845 Oct 14 03:12:42.400924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 398/773] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:42 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:43.102878 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-45c02de1-671d-4214-b32d-70de92b51443 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:43.103500 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-45c02de1-671d-4214-b32d-70de92b51443 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:43.110091 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45c02de1-671d-4214-b32d-70de92b51443 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:43.110658 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45c02de1-671d-4214-b32d-70de92b51443 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:43.111101 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45c02de1-671d-4214-b32d-70de92b51443 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:43.111793 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45c02de1-671d-4214-b32d-70de92b51443 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:43.112250 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45c02de1-671d-4214-b32d-70de92b51443 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:43.112714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45c02de1-671d-4214-b32d-70de92b51443 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:43.254024 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-45c02de1-671d-4214-b32d-70de92b51443 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:43.262294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-45c02de1-671d-4214-b32d-70de92b51443 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1506 microversion: 2.1 time: 0.163402 Oct 14 03:12:43.264311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 376/774] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:43 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:43.422846 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-cc91b92d-c92b-4189-b489-d7d2956f3acf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:43.423517 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-cc91b92d-c92b-4189-b489-d7d2956f3acf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:43.430385 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cc91b92d-c92b-4189-b489-d7d2956f3acf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:43.430866 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cc91b92d-c92b-4189-b489-d7d2956f3acf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:43.431303 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cc91b92d-c92b-4189-b489-d7d2956f3acf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:43.431992 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cc91b92d-c92b-4189-b489-d7d2956f3acf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:43.432472 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cc91b92d-c92b-4189-b489-d7d2956f3acf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:43.432896 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cc91b92d-c92b-4189-b489-d7d2956f3acf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:43.492843 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-cc91b92d-c92b-4189-b489-d7d2956f3acf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:43.500578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-cc91b92d-c92b-4189-b489-d7d2956f3acf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1293 microversion: 2.1 time: 0.081597 Oct 14 03:12:43.501149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 399/775] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:43 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:44.285712 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f358576c-76de-4b80-ae31-0d6feb96654d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:44.286987 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f358576c-76de-4b80-ae31-0d6feb96654d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:44.293914 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f358576c-76de-4b80-ae31-0d6feb96654d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:44.294493 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f358576c-76de-4b80-ae31-0d6feb96654d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:44.295006 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f358576c-76de-4b80-ae31-0d6feb96654d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:44.295772 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f358576c-76de-4b80-ae31-0d6feb96654d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:44.296291 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f358576c-76de-4b80-ae31-0d6feb96654d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:44.296826 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f358576c-76de-4b80-ae31-0d6feb96654d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:44.434931 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-f358576c-76de-4b80-ae31-0d6feb96654d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:44.443154 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f358576c-76de-4b80-ae31-0d6feb96654d tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1506 microversion: 2.1 time: 0.160836 Oct 14 03:12:44.443724 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 377/776] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:44 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:44.524231 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-64e76fe4-9cbc-4ae9-98c3-bc46ba64e176 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:44.524808 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-64e76fe4-9cbc-4ae9-98c3-bc46ba64e176 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:44.531246 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-64e76fe4-9cbc-4ae9-98c3-bc46ba64e176 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:44.531730 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-64e76fe4-9cbc-4ae9-98c3-bc46ba64e176 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:44.532163 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-64e76fe4-9cbc-4ae9-98c3-bc46ba64e176 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:44.532896 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-64e76fe4-9cbc-4ae9-98c3-bc46ba64e176 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:44.533405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-64e76fe4-9cbc-4ae9-98c3-bc46ba64e176 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:44.533833 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-64e76fe4-9cbc-4ae9-98c3-bc46ba64e176 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:44.594785 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-64e76fe4-9cbc-4ae9-98c3-bc46ba64e176 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:44.603077 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-64e76fe4-9cbc-4ae9-98c3-bc46ba64e176 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1293 microversion: 2.1 time: 0.082965 Oct 14 03:12:44.609147 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 400/777] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:44 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:44.749530 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-750dac27-b9cb-47e7-b13d-d2055bb25a34 req-8ef455d4-66c5-430f-bbc1-971b3387d462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eba7914-770c-4046-8f3d-9aebbe748f2d", "name": "network-vif-deleted", "tag": "7fd90ce6-674c-4948-9a24-8092bd69d422"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:44.759345 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-750dac27-b9cb-47e7-b13d-d2055bb25a34 req-8ef455d4-66c5-430f-bbc1-971b3387d462 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:44.759831 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-750dac27-b9cb-47e7-b13d-d2055bb25a34 req-8ef455d4-66c5-430f-bbc1-971b3387d462 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:44.760479 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-750dac27-b9cb-47e7-b13d-d2055bb25a34 req-8ef455d4-66c5-430f-bbc1-971b3387d462 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:44.776598 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-750dac27-b9cb-47e7-b13d-d2055bb25a34 req-8ef455d4-66c5-430f-bbc1-971b3387d462 service nova] Creating event network-vif-deleted:7fd90ce6-674c-4948-9a24-8092bd69d422 for instance 5eba7914-770c-4046-8f3d-9aebbe748f2d on hv-cinder-80152 Oct 14 03:12:44.784554 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-750dac27-b9cb-47e7-b13d-d2055bb25a34 req-8ef455d4-66c5-430f-bbc1-971b3387d462 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038362 Oct 14 03:12:44.786422 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 378/778] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:45.466800 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-47bd30eb-07a7-461c-8acf-662677588c68 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:45.467419 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-47bd30eb-07a7-461c-8acf-662677588c68 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:45.473562 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47bd30eb-07a7-461c-8acf-662677588c68 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:45.477268 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47bd30eb-07a7-461c-8acf-662677588c68 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:45.477268 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47bd30eb-07a7-461c-8acf-662677588c68 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:45.477268 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47bd30eb-07a7-461c-8acf-662677588c68 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:45.477268 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47bd30eb-07a7-461c-8acf-662677588c68 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:45.477629 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47bd30eb-07a7-461c-8acf-662677588c68 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:45.511072 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47bd30eb-07a7-461c-8acf-662677588c68 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:45.511072 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47bd30eb-07a7-461c-8acf-662677588c68 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:45.511072 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-47bd30eb-07a7-461c-8acf-662677588c68 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:45.511570 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-47bd30eb-07a7-461c-8acf-662677588c68 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lazy-loading 'fault' on Instance uuid 5eba7914-770c-4046-8f3d-9aebbe748f2d {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:45.514500 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:45.567012 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-47bd30eb-07a7-461c-8acf-662677588c68 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:45.574482 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-cc384acc-c583-49b9-a26d-301580274382 req-8912017a-2530-4250-9a29-0c73aca8f936 admin admin] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:45.576414 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-47bd30eb-07a7-461c-8acf-662677588c68 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1311 microversion: 2.1 time: 0.113548 Oct 14 03:12:45.580562 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 401/779] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:45 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:45.580686 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-cc384acc-c583-49b9-a26d-301580274382 req-8912017a-2530-4250-9a29-0c73aca8f936 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:45.580686 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-cc384acc-c583-49b9-a26d-301580274382 req-8912017a-2530-4250-9a29-0c73aca8f936 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:45.580686 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-cc384acc-c583-49b9-a26d-301580274382 req-8912017a-2530-4250-9a29-0c73aca8f936 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:45.595247 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-cc384acc-c583-49b9-a26d-301580274382 req-8912017a-2530-4250-9a29-0c73aca8f936 admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:45.595734 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-cc384acc-c583-49b9-a26d-301580274382 req-8912017a-2530-4250-9a29-0c73aca8f936 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:45.596167 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-cc384acc-c583-49b9-a26d-301580274382 req-8912017a-2530-4250-9a29-0c73aca8f936 admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:45.610270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-cc384acc-c583-49b9-a26d-301580274382 req-8912017a-2530-4250-9a29-0c73aca8f936 admin admin] 10.222.0.44 "DELETE /compute/v2.1/os-assisted-volume-snapshots/bbcffd43-a924-4fde-bebe-94f5b0b97b12?delete_info=%7B%22file_to_merge%22:%20%22volume-fd1db9a1-d651-4fab-8c77-36ed1a234674.bbcffd43-a924-4fde-bebe-94f5b0b97b12.vhdx%22,%20%22volume_id%22:%20%22fd1db9a1-d651-4fab-8c77-36ed1a234674%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.091941 Oct 14 03:12:45.610858 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 379/780] 10.222.0.44 () {62 vars in 1800 bytes} [Fri Oct 14 03:12:45 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/bbcffd43-a924-4fde-bebe-94f5b0b97b12?delete_info=%7B%22file_to_merge%22:%20%22volume-fd1db9a1-d651-4fab-8c77-36ed1a234674.bbcffd43-a924-4fde-bebe-94f5b0b97b12.vhdx%22,%20%22volume_id%22:%20%22fd1db9a1-d651-4fab-8c77-36ed1a234674%22%7D => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 03:12:45.626931 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-01f2ded9-0eb9-4963-94e2-8a0ed62cba2f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:45.627546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-01f2ded9-0eb9-4963-94e2-8a0ed62cba2f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:45.634492 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-01f2ded9-0eb9-4963-94e2-8a0ed62cba2f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:45.634989 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-01f2ded9-0eb9-4963-94e2-8a0ed62cba2f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:45.635427 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-01f2ded9-0eb9-4963-94e2-8a0ed62cba2f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:45.636172 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-01f2ded9-0eb9-4963-94e2-8a0ed62cba2f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:45.637307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-01f2ded9-0eb9-4963-94e2-8a0ed62cba2f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:45.637740 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-01f2ded9-0eb9-4963-94e2-8a0ed62cba2f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:45.711113 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-01f2ded9-0eb9-4963-94e2-8a0ed62cba2f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:45.723444 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-01f2ded9-0eb9-4963-94e2-8a0ed62cba2f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1299 microversion: 2.1 time: 0.095906 Oct 14 03:12:45.723444 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 402/781] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:45 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:46.601060 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-025ae3a7-083e-4e06-b516-68bb90ff87f4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:46.601752 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-025ae3a7-083e-4e06-b516-68bb90ff87f4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:46.607962 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-025ae3a7-083e-4e06-b516-68bb90ff87f4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:46.608468 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-025ae3a7-083e-4e06-b516-68bb90ff87f4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:46.608932 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-025ae3a7-083e-4e06-b516-68bb90ff87f4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:46.609616 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-025ae3a7-083e-4e06-b516-68bb90ff87f4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:46.610065 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-025ae3a7-083e-4e06-b516-68bb90ff87f4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:46.610506 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-025ae3a7-083e-4e06-b516-68bb90ff87f4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:46.640865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-025ae3a7-083e-4e06-b516-68bb90ff87f4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:46.641420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-025ae3a7-083e-4e06-b516-68bb90ff87f4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:46.641921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-025ae3a7-083e-4e06-b516-68bb90ff87f4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:46.642370 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-025ae3a7-083e-4e06-b516-68bb90ff87f4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lazy-loading 'fault' on Instance uuid 5eba7914-770c-4046-8f3d-9aebbe748f2d {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:46.682822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-025ae3a7-083e-4e06-b516-68bb90ff87f4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:46.690379 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-025ae3a7-083e-4e06-b516-68bb90ff87f4 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 200 len: 1311 microversion: 2.1 time: 0.094658 Oct 14 03:12:46.690941 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 380/782] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:46 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:46.742864 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-37cc5cd5-9cc3-437c-8f85-ff480d03dd12 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:46.743592 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-37cc5cd5-9cc3-437c-8f85-ff480d03dd12 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:46.750731 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37cc5cd5-9cc3-437c-8f85-ff480d03dd12 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:46.751384 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37cc5cd5-9cc3-437c-8f85-ff480d03dd12 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:46.751802 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37cc5cd5-9cc3-437c-8f85-ff480d03dd12 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:46.752635 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37cc5cd5-9cc3-437c-8f85-ff480d03dd12 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:46.753161 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37cc5cd5-9cc3-437c-8f85-ff480d03dd12 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:46.753653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-37cc5cd5-9cc3-437c-8f85-ff480d03dd12 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:46.886123 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-37cc5cd5-9cc3-437c-8f85-ff480d03dd12 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:46.894435 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-37cc5cd5-9cc3-437c-8f85-ff480d03dd12 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1366 microversion: 2.1 time: 0.156996 Oct 14 03:12:46.899610 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 403/783] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:46 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:47.472715 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-4441a442-cfd8-4d75-85fd-dff7b7830334 req-a1fd5310-1aab-45f9-9291-f0d068d62618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d", "tag": "06fd51ef-122c-4339-9704-90cd3f5bc8b9"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:47.484333 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-4441a442-cfd8-4d75-85fd-dff7b7830334 req-a1fd5310-1aab-45f9-9291-f0d068d62618 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:47.485289 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-4441a442-cfd8-4d75-85fd-dff7b7830334 req-a1fd5310-1aab-45f9-9291-f0d068d62618 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:47.485995 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-4441a442-cfd8-4d75-85fd-dff7b7830334 req-a1fd5310-1aab-45f9-9291-f0d068d62618 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:47.500588 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-4441a442-cfd8-4d75-85fd-dff7b7830334 req-a1fd5310-1aab-45f9-9291-f0d068d62618 service nova] Creating event network-changed:06fd51ef-122c-4339-9704-90cd3f5bc8b9 for instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d on hv-cinder-80152 Oct 14 03:12:47.505711 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-4441a442-cfd8-4d75-85fd-dff7b7830334 req-a1fd5310-1aab-45f9-9291-f0d068d62618 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038223 Oct 14 03:12:47.506345 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 381/784] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:47.714360 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f637883f-dd50-4e01-92fa-6b5f6b6eb5e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:47.715023 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f637883f-dd50-4e01-92fa-6b5f6b6eb5e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: 5eba7914-770c-4046-8f3d-9aebbe748f2d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:47.721072 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f637883f-dd50-4e01-92fa-6b5f6b6eb5e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:47.721504 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f637883f-dd50-4e01-92fa-6b5f6b6eb5e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:47.721940 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f637883f-dd50-4e01-92fa-6b5f6b6eb5e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:47.722636 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f637883f-dd50-4e01-92fa-6b5f6b6eb5e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:47.723094 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f637883f-dd50-4e01-92fa-6b5f6b6eb5e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:47.723519 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f637883f-dd50-4e01-92fa-6b5f6b6eb5e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:47.739097 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-f637883f-dd50-4e01-92fa-6b5f6b6eb5e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] HTTP exception thrown: Instance 5eba7914-770c-4046-8f3d-9aebbe748f2d could not be found. Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f637883f-dd50-4e01-92fa-6b5f6b6eb5e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Request method failure captured: Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d HTTP/1.1 Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNKH4NxEPMl2MiNB1XCe-xt7krq1NrhiwWzh8PUcUNc7DPMToyK61BYEVmqnH8PcIjU4NdaDSCKUk9p7hizeKHSG12vRmixqmA6Av241GRS3ISj8jYf2FW8S0N5rYB7-2yQkL3Hn58t-PG07p68TryoPL80eVR0qFpm0wcS-Fmdl0QQ Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 61f89b8e68d14d3d96fa84ab1697fcea Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:12:47.740924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:12:47.742880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:12:47.742880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:12:47.742880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 61f89b8e68d14d3d96fa84ab1697fcea Oct 14 03:12:47.742880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:12:47.742880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-ServerRescueNegativeTestJSON-883339385-project Oct 14 03:12:47.742880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:12:47.742880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:12:47.742880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: dbf0723a0f3942d2b9b2554320878016 Oct 14 03:12:47.742880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-ServerRescueNegativeTestJSON-883339385-project Oct 14 03:12:47.742880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:12:47.742880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance 5eba7914-770c-4046-8f3d-9aebbe748f2d could not be found. Oct 14 03:12:47.742880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '5eba7914-770c-4046-8f3d-9aebbe748f2d'} Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eba7914-770c-4046-8f3d-9aebbe748f2d could not be found. Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:12:47.744226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eba7914-770c-4046-8f3d-9aebbe748f2d could not be found. Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eba7914-770c-4046-8f3d-9aebbe748f2d could not be found. Oct 14 03:12:47.746047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:12:47.747670 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f637883f-dd50-4e01-92fa-6b5f6b6eb5e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Returning 404 to user: Instance 5eba7914-770c-4046-8f3d-9aebbe748f2d could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:12:47.747670 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f637883f-dd50-4e01-92fa-6b5f6b6eb5e3 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d" status: 404 len: 111 microversion: 2.1 time: 0.033319 Oct 14 03:12:47.747670 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 404/785] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:47 2022] GET /compute/v2.1/servers/5eba7914-770c-4046-8f3d-9aebbe748f2d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:12:47.752486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-79067370-bd16-4514-86e9-3771e6ada868 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:47.753067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-79067370-bd16-4514-86e9-3771e6ada868 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:47.759184 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-79067370-bd16-4514-86e9-3771e6ada868 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:47.759670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-79067370-bd16-4514-86e9-3771e6ada868 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:47.760108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-79067370-bd16-4514-86e9-3771e6ada868 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:47.760851 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-79067370-bd16-4514-86e9-3771e6ada868 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:47.761291 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-79067370-bd16-4514-86e9-3771e6ada868 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:47.761718 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-79067370-bd16-4514-86e9-3771e6ada868 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:47.786503 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-79067370-bd16-4514-86e9-3771e6ada868 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Going to try to terminate instance {{(pid=119302) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:12:47.917923 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-2a292b40-94e1-4091-9191-9df595023a75 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:47.918583 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-2a292b40-94e1-4091-9191-9df595023a75 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:47.924845 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2a292b40-94e1-4091-9191-9df595023a75 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:47.925324 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2a292b40-94e1-4091-9191-9df595023a75 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:47.925771 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2a292b40-94e1-4091-9191-9df595023a75 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:47.926450 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2a292b40-94e1-4091-9191-9df595023a75 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:47.926901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2a292b40-94e1-4091-9191-9df595023a75 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:47.927325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2a292b40-94e1-4091-9191-9df595023a75 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:48.053860 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-2a292b40-94e1-4091-9191-9df595023a75 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:48.061614 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-2a292b40-94e1-4091-9191-9df595023a75 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1366 microversion: 2.1 time: 0.147535 Oct 14 03:12:48.062187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 405/786] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:47 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:48.083551 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-79067370-bd16-4514-86e9-3771e6ada868 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 204 len: 0 microversion: 2.1 time: 0.335560 Oct 14 03:12:48.084133 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 382/787] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:12:47 2022] DELETE /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:12:48.092591 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-4f5cdcf4-5178-4a8c-a005-74a1e9c22aec tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:48.093202 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-4f5cdcf4-5178-4a8c-a005-74a1e9c22aec tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:48.099144 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4f5cdcf4-5178-4a8c-a005-74a1e9c22aec tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:48.099634 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4f5cdcf4-5178-4a8c-a005-74a1e9c22aec tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:48.100072 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4f5cdcf4-5178-4a8c-a005-74a1e9c22aec tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:48.100895 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4f5cdcf4-5178-4a8c-a005-74a1e9c22aec tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:48.101326 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4f5cdcf4-5178-4a8c-a005-74a1e9c22aec tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:48.103751 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4f5cdcf4-5178-4a8c-a005-74a1e9c22aec tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:48.227760 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4f5cdcf4-5178-4a8c-a005-74a1e9c22aec tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:48.245142 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-4f5cdcf4-5178-4a8c-a005-74a1e9c22aec tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.156228 Oct 14 03:12:48.260916 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 406/788] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:48 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:49.084599 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-89fae5a2-aca1-4b64-8bb3-c043482d5c80 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:49.085320 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-89fae5a2-aca1-4b64-8bb3-c043482d5c80 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:49.087722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=6 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:49.092525 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-89fae5a2-aca1-4b64-8bb3-c043482d5c80 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:49.092994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-89fae5a2-aca1-4b64-8bb3-c043482d5c80 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:49.093432 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-89fae5a2-aca1-4b64-8bb3-c043482d5c80 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:49.094122 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-89fae5a2-aca1-4b64-8bb3-c043482d5c80 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:49.094579 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-89fae5a2-aca1-4b64-8bb3-c043482d5c80 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:49.095002 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-89fae5a2-aca1-4b64-8bb3-c043482d5c80 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:49.228687 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-89fae5a2-aca1-4b64-8bb3-c043482d5c80 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:49.236088 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-89fae5a2-aca1-4b64-8bb3-c043482d5c80 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1366 microversion: 2.1 time: 0.155778 Oct 14 03:12:49.236685 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 383/789] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:49 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:49.269438 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8bfe3831-8f54-493d-b859-ccb8262ad707 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:49.270050 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8bfe3831-8f54-493d-b859-ccb8262ad707 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:49.272874 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=6 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:49.277588 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8bfe3831-8f54-493d-b859-ccb8262ad707 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:49.278076 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8bfe3831-8f54-493d-b859-ccb8262ad707 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:49.278519 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8bfe3831-8f54-493d-b859-ccb8262ad707 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:49.279213 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8bfe3831-8f54-493d-b859-ccb8262ad707 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:49.279674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8bfe3831-8f54-493d-b859-ccb8262ad707 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:49.280101 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8bfe3831-8f54-493d-b859-ccb8262ad707 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:49.405245 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8bfe3831-8f54-493d-b859-ccb8262ad707 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:49.413522 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8bfe3831-8f54-493d-b859-ccb8262ad707 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.147286 Oct 14 03:12:49.414105 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 407/790] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:49 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:50.259654 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-5dea7715-7f27-40f7-b34b-20d461c72fa0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:50.260265 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-5dea7715-7f27-40f7-b34b-20d461c72fa0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:50.266694 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5dea7715-7f27-40f7-b34b-20d461c72fa0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:50.267174 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5dea7715-7f27-40f7-b34b-20d461c72fa0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:50.267607 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5dea7715-7f27-40f7-b34b-20d461c72fa0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:50.268286 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5dea7715-7f27-40f7-b34b-20d461c72fa0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:50.268764 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5dea7715-7f27-40f7-b34b-20d461c72fa0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:50.269185 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-5dea7715-7f27-40f7-b34b-20d461c72fa0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:50.436187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e2b8a824-efba-4e29-aaa3-369e641b0583 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:50.436842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e2b8a824-efba-4e29-aaa3-369e641b0583 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:50.443353 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e2b8a824-efba-4e29-aaa3-369e641b0583 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:50.443679 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-5dea7715-7f27-40f7-b34b-20d461c72fa0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:50.443841 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e2b8a824-efba-4e29-aaa3-369e641b0583 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:50.444275 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e2b8a824-efba-4e29-aaa3-369e641b0583 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:50.445005 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e2b8a824-efba-4e29-aaa3-369e641b0583 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:50.445456 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e2b8a824-efba-4e29-aaa3-369e641b0583 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:50.445874 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e2b8a824-efba-4e29-aaa3-369e641b0583 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:50.451242 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-5dea7715-7f27-40f7-b34b-20d461c72fa0 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1366 microversion: 2.1 time: 0.196053 Oct 14 03:12:50.451811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 384/791] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:50 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:50.571751 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-e2b8a824-efba-4e29-aaa3-369e641b0583 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:50.579485 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e2b8a824-efba-4e29-aaa3-369e641b0583 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.147155 Oct 14 03:12:50.580052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 408/792] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:50 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:51.473802 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c8c19b8f-4030-475a-b2bc-b2028dfd988a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:51.474332 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c8c19b8f-4030-475a-b2bc-b2028dfd988a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:51.481400 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c8c19b8f-4030-475a-b2bc-b2028dfd988a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:51.481876 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c8c19b8f-4030-475a-b2bc-b2028dfd988a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:51.482315 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c8c19b8f-4030-475a-b2bc-b2028dfd988a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:51.483003 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c8c19b8f-4030-475a-b2bc-b2028dfd988a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:51.483451 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c8c19b8f-4030-475a-b2bc-b2028dfd988a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:51.483873 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c8c19b8f-4030-475a-b2bc-b2028dfd988a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:51.602742 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-034f98d6-72f1-4266-80c3-747005701faa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:51.603352 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-034f98d6-72f1-4266-80c3-747005701faa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:51.609564 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-034f98d6-72f1-4266-80c3-747005701faa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:51.610046 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-034f98d6-72f1-4266-80c3-747005701faa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:51.610477 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-034f98d6-72f1-4266-80c3-747005701faa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:51.611169 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-034f98d6-72f1-4266-80c3-747005701faa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:51.611621 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-034f98d6-72f1-4266-80c3-747005701faa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:51.612037 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-034f98d6-72f1-4266-80c3-747005701faa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:51.613798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c8c19b8f-4030-475a-b2bc-b2028dfd988a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:51.621667 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c8c19b8f-4030-475a-b2bc-b2028dfd988a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1366 microversion: 2.1 time: 0.151484 Oct 14 03:12:51.622239 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 385/793] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:51 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:51.737490 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-034f98d6-72f1-4266-80c3-747005701faa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:51.745090 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-034f98d6-72f1-4266-80c3-747005701faa tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.146857 Oct 14 03:12:51.745653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 409/794] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:51 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:52.643049 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9dbffe43-8723-4329-b941-7f92024eec54 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:52.643656 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9dbffe43-8723-4329-b941-7f92024eec54 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:52.650435 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9dbffe43-8723-4329-b941-7f92024eec54 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:52.651111 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9dbffe43-8723-4329-b941-7f92024eec54 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:52.651731 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9dbffe43-8723-4329-b941-7f92024eec54 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:52.652633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9dbffe43-8723-4329-b941-7f92024eec54 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:52.653082 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9dbffe43-8723-4329-b941-7f92024eec54 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:52.653675 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9dbffe43-8723-4329-b941-7f92024eec54 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:52.769637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ea207a90-68b2-48af-942f-0b0909e0027e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:52.770342 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ea207a90-68b2-48af-942f-0b0909e0027e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:52.777055 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea207a90-68b2-48af-942f-0b0909e0027e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:52.777653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea207a90-68b2-48af-942f-0b0909e0027e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:52.778151 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea207a90-68b2-48af-942f-0b0909e0027e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:52.778915 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea207a90-68b2-48af-942f-0b0909e0027e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:52.779440 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea207a90-68b2-48af-942f-0b0909e0027e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:52.779944 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea207a90-68b2-48af-942f-0b0909e0027e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:52.785556 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9dbffe43-8723-4329-b941-7f92024eec54 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:52.793545 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9dbffe43-8723-4329-b941-7f92024eec54 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1366 microversion: 2.1 time: 0.154393 Oct 14 03:12:52.794121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 386/795] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:52 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:52.928066 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ea207a90-68b2-48af-942f-0b0909e0027e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:52.936193 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ea207a90-68b2-48af-942f-0b0909e0027e tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1521 microversion: 2.1 time: 0.171197 Oct 14 03:12:52.936815 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 410/796] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:52 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:53.651598 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-56017a9d-31a7-4bc0-8bc7-28f32417f596 req-9dba3c08-bec4-4a20-97e3-79e791cc7181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7", "name": "network-vif-deleted", "tag": "49678582-fb67-44bd-a6ab-cc4d65ebe2bc"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:53.661683 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-56017a9d-31a7-4bc0-8bc7-28f32417f596 req-9dba3c08-bec4-4a20-97e3-79e791cc7181 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:53.662156 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-56017a9d-31a7-4bc0-8bc7-28f32417f596 req-9dba3c08-bec4-4a20-97e3-79e791cc7181 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:53.662587 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-56017a9d-31a7-4bc0-8bc7-28f32417f596 req-9dba3c08-bec4-4a20-97e3-79e791cc7181 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:53.674748 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-56017a9d-31a7-4bc0-8bc7-28f32417f596 req-9dba3c08-bec4-4a20-97e3-79e791cc7181 service nova] Creating event network-vif-deleted:49678582-fb67-44bd-a6ab-cc4d65ebe2bc for instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 on hv-cinder-80152 Oct 14 03:12:53.679546 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-56017a9d-31a7-4bc0-8bc7-28f32417f596 req-9dba3c08-bec4-4a20-97e3-79e791cc7181 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032185 Oct 14 03:12:53.680743 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 387/797] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:53.816535 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0d7b78c4-f7fc-4099-95d9-4f229af2fe4f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:53.817080 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0d7b78c4-f7fc-4099-95d9-4f229af2fe4f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:53.823976 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0d7b78c4-f7fc-4099-95d9-4f229af2fe4f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:53.824472 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0d7b78c4-f7fc-4099-95d9-4f229af2fe4f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:53.824903 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0d7b78c4-f7fc-4099-95d9-4f229af2fe4f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:53.825586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0d7b78c4-f7fc-4099-95d9-4f229af2fe4f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:53.826032 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0d7b78c4-f7fc-4099-95d9-4f229af2fe4f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:53.826450 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0d7b78c4-f7fc-4099-95d9-4f229af2fe4f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:53.935958 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-39603145-1f1d-4b23-9d50-fbeb15d92562 req-d50bd294-e6d9-49d9-ab95-05a36de58d4c admin admin] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:53.939358 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-39603145-1f1d-4b23-9d50-fbeb15d92562 req-d50bd294-e6d9-49d9-ab95-05a36de58d4c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:53.939916 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-39603145-1f1d-4b23-9d50-fbeb15d92562 req-d50bd294-e6d9-49d9-ab95-05a36de58d4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:53.940438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-39603145-1f1d-4b23-9d50-fbeb15d92562 req-d50bd294-e6d9-49d9-ab95-05a36de58d4c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:53.950165 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-39603145-1f1d-4b23-9d50-fbeb15d92562 req-d50bd294-e6d9-49d9-ab95-05a36de58d4c admin admin] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:53.952165 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-39603145-1f1d-4b23-9d50-fbeb15d92562 req-d50bd294-e6d9-49d9-ab95-05a36de58d4c admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:53.952165 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-39603145-1f1d-4b23-9d50-fbeb15d92562 req-d50bd294-e6d9-49d9-ab95-05a36de58d4c admin admin] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:53.962774 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0d7b78c4-f7fc-4099-95d9-4f229af2fe4f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:53.967494 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-39603145-1f1d-4b23-9d50-fbeb15d92562 req-d50bd294-e6d9-49d9-ab95-05a36de58d4c admin admin] 10.222.0.44 "DELETE /compute/v2.1/os-assisted-volume-snapshots/23ff9b97-d632-4ccb-a304-8d4f9eb76643?delete_info=%7B%22file_to_merge%22:%20%22volume-fd1db9a1-d651-4fab-8c77-36ed1a234674.23ff9b97-d632-4ccb-a304-8d4f9eb76643.vhdx%22,%20%22volume_id%22:%20%22fd1db9a1-d651-4fab-8c77-36ed1a234674%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.085334 Oct 14 03:12:53.968323 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 388/798] 10.222.0.44 () {62 vars in 1800 bytes} [Fri Oct 14 03:12:53 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/23ff9b97-d632-4ccb-a304-8d4f9eb76643?delete_info=%7B%22file_to_merge%22:%20%22volume-fd1db9a1-d651-4fab-8c77-36ed1a234674.23ff9b97-d632-4ccb-a304-8d4f9eb76643.vhdx%22,%20%22volume_id%22:%20%22fd1db9a1-d651-4fab-8c77-36ed1a234674%22%7D => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 03:12:53.971893 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0d7b78c4-f7fc-4099-95d9-4f229af2fe4f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1366 microversion: 2.1 time: 0.159215 Oct 14 03:12:53.972815 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 411/799] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:53 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:53.973874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-01b63fb1-e009-49cf-985a-69d0fc320d67 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:53.974575 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-01b63fb1-e009-49cf-985a-69d0fc320d67 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:53.980983 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-01b63fb1-e009-49cf-985a-69d0fc320d67 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:53.981470 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-01b63fb1-e009-49cf-985a-69d0fc320d67 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:53.981911 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-01b63fb1-e009-49cf-985a-69d0fc320d67 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:53.982771 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-01b63fb1-e009-49cf-985a-69d0fc320d67 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:53.983236 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-01b63fb1-e009-49cf-985a-69d0fc320d67 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:53.983664 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-01b63fb1-e009-49cf-985a-69d0fc320d67 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:54.000157 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:54.048879 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-01b63fb1-e009-49cf-985a-69d0fc320d67 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:54.057480 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-01b63fb1-e009-49cf-985a-69d0fc320d67 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1479 microversion: 2.1 time: 0.087677 Oct 14 03:12:54.058069 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 389/800] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:53 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1479 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:54.996001 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e635d4b9-b022-4cae-b85f-3240e7df4e4c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:54.996583 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e635d4b9-b022-4cae-b85f-3240e7df4e4c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:54.999125 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:55.003734 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e635d4b9-b022-4cae-b85f-3240e7df4e4c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:55.004218 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e635d4b9-b022-4cae-b85f-3240e7df4e4c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:55.004691 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e635d4b9-b022-4cae-b85f-3240e7df4e4c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:55.005382 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e635d4b9-b022-4cae-b85f-3240e7df4e4c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:55.005840 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e635d4b9-b022-4cae-b85f-3240e7df4e4c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:55.006263 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e635d4b9-b022-4cae-b85f-3240e7df4e4c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:55.080651 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a085621c-e457-4b3d-add4-7bdaf4092e8a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:55.081269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-a085621c-e457-4b3d-add4-7bdaf4092e8a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:55.088429 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a085621c-e457-4b3d-add4-7bdaf4092e8a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:55.088916 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a085621c-e457-4b3d-add4-7bdaf4092e8a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:55.089363 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a085621c-e457-4b3d-add4-7bdaf4092e8a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:55.090065 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a085621c-e457-4b3d-add4-7bdaf4092e8a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:55.090521 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a085621c-e457-4b3d-add4-7bdaf4092e8a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:55.090950 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a085621c-e457-4b3d-add4-7bdaf4092e8a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:55.124129 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a085621c-e457-4b3d-add4-7bdaf4092e8a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:55.124649 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a085621c-e457-4b3d-add4-7bdaf4092e8a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:55.125087 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a085621c-e457-4b3d-add4-7bdaf4092e8a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:55.125535 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-a085621c-e457-4b3d-add4-7bdaf4092e8a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lazy-loading 'fault' on Instance uuid d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:55.137937 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-e635d4b9-b022-4cae-b85f-3240e7df4e4c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:55.145609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e635d4b9-b022-4cae-b85f-3240e7df4e4c tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1366 microversion: 2.1 time: 0.154182 Oct 14 03:12:55.146233 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 412/801] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:54 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:55.168183 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a085621c-e457-4b3d-add4-7bdaf4092e8a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:55.175745 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-a085621c-e457-4b3d-add4-7bdaf4092e8a tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1311 microversion: 2.1 time: 0.099139 Oct 14 03:12:55.176308 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 390/802] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:55 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:56.169180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8706ca45-ca4b-4c5b-9526-50dd221a25d9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:56.169785 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8706ca45-ca4b-4c5b-9526-50dd221a25d9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:56.176361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8706ca45-ca4b-4c5b-9526-50dd221a25d9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:56.176862 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8706ca45-ca4b-4c5b-9526-50dd221a25d9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:56.177300 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8706ca45-ca4b-4c5b-9526-50dd221a25d9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:56.177983 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8706ca45-ca4b-4c5b-9526-50dd221a25d9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:56.178430 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8706ca45-ca4b-4c5b-9526-50dd221a25d9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:56.178877 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8706ca45-ca4b-4c5b-9526-50dd221a25d9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:56.198735 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-571cb454-5d4b-4e99-8097-598303b45cd2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:56.199347 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-571cb454-5d4b-4e99-8097-598303b45cd2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:56.205717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-571cb454-5d4b-4e99-8097-598303b45cd2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:56.206201 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-571cb454-5d4b-4e99-8097-598303b45cd2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:56.206639 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-571cb454-5d4b-4e99-8097-598303b45cd2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:56.207333 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-571cb454-5d4b-4e99-8097-598303b45cd2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:56.207797 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-571cb454-5d4b-4e99-8097-598303b45cd2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:56.208220 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-571cb454-5d4b-4e99-8097-598303b45cd2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:56.238982 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:56.242659 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-571cb454-5d4b-4e99-8097-598303b45cd2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:56.243082 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-571cb454-5d4b-4e99-8097-598303b45cd2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:56.244427 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-571cb454-5d4b-4e99-8097-598303b45cd2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:56.244427 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-571cb454-5d4b-4e99-8097-598303b45cd2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lazy-loading 'fault' on Instance uuid d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:56.297947 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-571cb454-5d4b-4e99-8097-598303b45cd2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf0723a0f3942d2b9b2554320878016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f89b8e68d14d3d96fa84ab1697fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:56.306425 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-571cb454-5d4b-4e99-8097-598303b45cd2 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 200 len: 1311 microversion: 2.1 time: 0.111494 Oct 14 03:12:56.307199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 391/803] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:56 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:56.341564 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8706ca45-ca4b-4c5b-9526-50dd221a25d9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:56.349061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8706ca45-ca4b-4c5b-9526-50dd221a25d9 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1366 microversion: 2.1 time: 0.184354 Oct 14 03:12:56.349635 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 413/804] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:56 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:57.330096 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-76ce3e1f-980a-45c1-bad2-9d442e9c4cc6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:57.330705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-76ce3e1f-980a-45c1-bad2-9d442e9c4cc6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] [instance: d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:57.337239 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-76ce3e1f-980a-45c1-bad2-9d442e9c4cc6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:57.337719 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-76ce3e1f-980a-45c1-bad2-9d442e9c4cc6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:57.338151 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-76ce3e1f-980a-45c1-bad2-9d442e9c4cc6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:57.338836 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-76ce3e1f-980a-45c1-bad2-9d442e9c4cc6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:57.339289 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-76ce3e1f-980a-45c1-bad2-9d442e9c4cc6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:57.339714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-76ce3e1f-980a-45c1-bad2-9d442e9c4cc6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:57.353385 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-76ce3e1f-980a-45c1-bad2-9d442e9c4cc6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] HTTP exception thrown: Instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 could not be found. Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-76ce3e1f-980a-45c1-bad2-9d442e9c4cc6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Request method failure captured: Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 HTTP/1.1 Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKH4NxEPMl2MiNB1XCe-xt7krq1NrhiwWzh8PUcUNc7DPMToyK61BYEVmqnH8PcIjU4NdaDSCKUk9p7hizeKHSG12vRmixqmA6Av241GRS3ISj8jYf2FW8S0N5rYB7-2yQkL3Hn58t-PG07p68TryoPL80eVR0qFpm0wcS-Fmdl0QQ Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 61f89b8e68d14d3d96fa84ab1697fcea Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:12:57.354999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:12:57.356583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_61f89b8e68d14d3d96fa84ab1697fcea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:12:57.356583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:12:57.356583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 61f89b8e68d14d3d96fa84ab1697fcea Oct 14 03:12:57.356583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-883339385 Oct 14 03:12:57.356583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-ServerRescueNegativeTestJSON-883339385-project Oct 14 03:12:57.356583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:12:57.356583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:12:57.356583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: dbf0723a0f3942d2b9b2554320878016 Oct 14 03:12:57.356583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-ServerRescueNegativeTestJSON-883339385-project Oct 14 03:12:57.356583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:12:57.356583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 could not be found. Oct 14 03:12:57.356583 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': 'd77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7'} Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 could not be found. Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:12:57.357452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 could not be found. Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 could not be found. Oct 14 03:12:57.358933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:12:57.360267 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-76ce3e1f-980a-45c1-bad2-9d442e9c4cc6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] Returning 404 to user: Instance d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:12:57.360267 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-76ce3e1f-980a-45c1-bad2-9d442e9c4cc6 tempest-ServerRescueNegativeTestJSON-883339385 tempest-ServerRescueNegativeTestJSON-883339385-project] 10.222.0.13 "GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7" status: 404 len: 111 microversion: 2.1 time: 0.030180 Oct 14 03:12:57.360267 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 392/805] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:57 2022] GET /compute/v2.1/servers/d77a7703-4e81-4fa8-b3aa-f3b7e7ae93d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:12:57.372212 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-cdb93f76-5490-4f2c-b80a-66f600131aac tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:57.373097 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-cdb93f76-5490-4f2c-b80a-66f600131aac tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:57.380051 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cdb93f76-5490-4f2c-b80a-66f600131aac tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:57.380572 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cdb93f76-5490-4f2c-b80a-66f600131aac tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:57.381065 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cdb93f76-5490-4f2c-b80a-66f600131aac tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:57.381771 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cdb93f76-5490-4f2c-b80a-66f600131aac tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:57.382230 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cdb93f76-5490-4f2c-b80a-66f600131aac tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:57.382663 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cdb93f76-5490-4f2c-b80a-66f600131aac tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:57.632379 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-cdb93f76-5490-4f2c-b80a-66f600131aac tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:57.640234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-cdb93f76-5490-4f2c-b80a-66f600131aac tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1366 microversion: 2.1 time: 0.272898 Oct 14 03:12:57.640838 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 414/806] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:57 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:57.907110 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-cf1380c3-80ff-4650-bb7f-755d616bbe09 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:57.907707 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-cf1380c3-80ff-4650-bb7f-755d616bbe09 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:57.914753 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cf1380c3-80ff-4650-bb7f-755d616bbe09 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:57.915242 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cf1380c3-80ff-4650-bb7f-755d616bbe09 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:57.915683 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cf1380c3-80ff-4650-bb7f-755d616bbe09 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:57.916398 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cf1380c3-80ff-4650-bb7f-755d616bbe09 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:57.916864 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cf1380c3-80ff-4650-bb7f-755d616bbe09 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:57.917293 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cf1380c3-80ff-4650-bb7f-755d616bbe09 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:57.999087 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-cf1380c3-80ff-4650-bb7f-755d616bbe09 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lazy-loading 'services' on Instance uuid ec35719e-f7e5-4961-b289-277efae29da5 {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:58.154580 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-cf1380c3-80ff-4650-bb7f-755d616bbe09 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5/os-volume_attachments/fd1db9a1-d651-4fab-8c77-36ed1a234674" status: 202 len: 0 microversion: 2.1 time: 0.251104 Oct 14 03:12:58.155227 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 393/807] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Oct 14 03:12:57 2022] DELETE /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5/os-volume_attachments/fd1db9a1-d651-4fab-8c77-36ed1a234674 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:12:58.519108 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-ac0109c9-26ce-4194-a0a3-44a16195ec1c req-e6e62e41-3fa5-4a9b-8cd1-a30c939cd04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d", "name": "network-vif-plugged", "status": "completed", "tag": "06fd51ef-122c-4339-9704-90cd3f5bc8b9"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:58.534418 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-ac0109c9-26ce-4194-a0a3-44a16195ec1c req-e6e62e41-3fa5-4a9b-8cd1-a30c939cd04a service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:58.535094 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-ac0109c9-26ce-4194-a0a3-44a16195ec1c req-e6e62e41-3fa5-4a9b-8cd1-a30c939cd04a service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:58.535526 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-ac0109c9-26ce-4194-a0a3-44a16195ec1c req-e6e62e41-3fa5-4a9b-8cd1-a30c939cd04a service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:58.547180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-ac0109c9-26ce-4194-a0a3-44a16195ec1c req-e6e62e41-3fa5-4a9b-8cd1-a30c939cd04a service nova] Creating event network-vif-plugged:06fd51ef-122c-4339-9704-90cd3f5bc8b9 for instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d on hv-cinder-80152 Oct 14 03:12:58.552160 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-ac0109c9-26ce-4194-a0a3-44a16195ec1c req-e6e62e41-3fa5-4a9b-8cd1-a30c939cd04a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038725 Oct 14 03:12:58.552794 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 415/808] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:58.573042 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a1b3cda3-25a3-4e55-a124-0b6ae1c7f451 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1294556805"}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:58.573752 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-a1b3cda3-25a3-4e55-a124-0b6ae1c7f451 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:58.580367 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1b3cda3-25a3-4e55-a124-0b6ae1c7f451 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:58.580990 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1b3cda3-25a3-4e55-a124-0b6ae1c7f451 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:58.581502 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1b3cda3-25a3-4e55-a124-0b6ae1c7f451 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:58.582274 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1b3cda3-25a3-4e55-a124-0b6ae1c7f451 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:58.582800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1b3cda3-25a3-4e55-a124-0b6ae1c7f451 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:58.583298 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a1b3cda3-25a3-4e55-a124-0b6ae1c7f451 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:58.663822 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-978c31c5-6f2f-4e7c-82c6-37800cb1ca28 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:58.664613 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-978c31c5-6f2f-4e7c-82c6-37800cb1ca28 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:58.672790 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-978c31c5-6f2f-4e7c-82c6-37800cb1ca28 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:58.673620 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-978c31c5-6f2f-4e7c-82c6-37800cb1ca28 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:58.676787 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-978c31c5-6f2f-4e7c-82c6-37800cb1ca28 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:58.677744 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-978c31c5-6f2f-4e7c-82c6-37800cb1ca28 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:58.678428 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-978c31c5-6f2f-4e7c-82c6-37800cb1ca28 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:58.678949 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-978c31c5-6f2f-4e7c-82c6-37800cb1ca28 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:59.111819 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.network.security_group_api [None req-a1b3cda3-25a3-4e55-a124-0b6ae1c7f451 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Removing security group 6b0fe4d3-34b1-4ffb-a3d9-eb17dd591c8a from port fcb4f2b3-a43c-4d79-98f7-46d493d8d296 Oct 14 03:12:59.267810 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-978c31c5-6f2f-4e7c-82c6-37800cb1ca28 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:59.277530 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-978c31c5-6f2f-4e7c-82c6-37800cb1ca28 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1366 microversion: 2.1 time: 0.617358 Oct 14 03:12:59.287122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 416/809] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:58 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1366 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:59.704646 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-a1b3cda3-25a3-4e55-a124-0b6ae1c7f451 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "POST /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/action" status: 202 len: 0 microversion: 2.1 time: 1.136380 Oct 14 03:12:59.705324 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 394/810] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Oct 14 03:12:58 2022] POST /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/action => generated 0 bytes in 1138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 03:12:59.719835 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-4b7fb212-9174-449e-a6ba-fdf338b678ec req-80ca8221-3ee7-46bb-9e4a-4947b75701f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c3606f-b3fb-4249-b5fd-a2de8f5debc2", "tag": "fcb4f2b3-a43c-4d79-98f7-46d493d8d296"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:59.742371 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-4b7fb212-9174-449e-a6ba-fdf338b678ec req-80ca8221-3ee7-46bb-9e4a-4947b75701f3 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:59.747987 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-4b7fb212-9174-449e-a6ba-fdf338b678ec req-80ca8221-3ee7-46bb-9e4a-4947b75701f3 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:59.753286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-4b7fb212-9174-449e-a6ba-fdf338b678ec req-80ca8221-3ee7-46bb-9e4a-4947b75701f3 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:59.782057 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-4b7fb212-9174-449e-a6ba-fdf338b678ec req-80ca8221-3ee7-46bb-9e4a-4947b75701f3 service nova] Creating event network-changed:fcb4f2b3-a43c-4d79-98f7-46d493d8d296 for instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 on hv-cinder-80152 Oct 14 03:12:59.802778 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-4b7fb212-9174-449e-a6ba-fdf338b678ec req-80ca8221-3ee7-46bb-9e4a-4947b75701f3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089711 Oct 14 03:12:59.807301 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 417/811] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:00.300335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e243c741-1ce8-435c-8de3-c7bd66beb4a8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:00.301083 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e243c741-1ce8-435c-8de3-c7bd66beb4a8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:00.309145 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e243c741-1ce8-435c-8de3-c7bd66beb4a8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:00.309794 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e243c741-1ce8-435c-8de3-c7bd66beb4a8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:00.310334 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e243c741-1ce8-435c-8de3-c7bd66beb4a8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:00.311168 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e243c741-1ce8-435c-8de3-c7bd66beb4a8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:00.311739 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e243c741-1ce8-435c-8de3-c7bd66beb4a8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:00.312292 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e243c741-1ce8-435c-8de3-c7bd66beb4a8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:00.547978 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e243c741-1ce8-435c-8de3-c7bd66beb4a8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:00.554420 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fe36f0c4-944e-4eb9-a52d-969af41a4df6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:00.555220 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fe36f0c4-944e-4eb9-a52d-969af41a4df6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:00.557198 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e243c741-1ce8-435c-8de3-c7bd66beb4a8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1366 microversion: 2.1 time: 0.260744 Oct 14 03:13:00.558804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 395/812] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:00 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:00.567420 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe36f0c4-944e-4eb9-a52d-969af41a4df6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:00.569084 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe36f0c4-944e-4eb9-a52d-969af41a4df6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:00.569703 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe36f0c4-944e-4eb9-a52d-969af41a4df6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:00.570643 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe36f0c4-944e-4eb9-a52d-969af41a4df6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:00.571299 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe36f0c4-944e-4eb9-a52d-969af41a4df6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:00.571877 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe36f0c4-944e-4eb9-a52d-969af41a4df6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:00.616236 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fe36f0c4-944e-4eb9-a52d-969af41a4df6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Going to try to terminate instance {{(pid=119301) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:13:00.734344 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:00.859791 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fe36f0c4-944e-4eb9-a52d-969af41a4df6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 204 len: 0 microversion: 2.1 time: 0.309677 Oct 14 03:13:00.860410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 418/813] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:13:00 2022] DELETE /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 03:13:00.868534 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-961e6c80-f778-4590-a480-e3c913643afa tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:00.869230 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-961e6c80-f778-4590-a480-e3c913643afa tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:00.876733 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-961e6c80-f778-4590-a480-e3c913643afa tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:00.877293 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-961e6c80-f778-4590-a480-e3c913643afa tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:00.877779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-961e6c80-f778-4590-a480-e3c913643afa tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:00.878479 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-961e6c80-f778-4590-a480-e3c913643afa tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:00.878992 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-961e6c80-f778-4590-a480-e3c913643afa tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:00.879421 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-961e6c80-f778-4590-a480-e3c913643afa tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.193869 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-961e6c80-f778-4590-a480-e3c913643afa tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:01.202300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-961e6c80-f778-4590-a480-e3c913643afa tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1513 microversion: 2.1 time: 0.337635 Oct 14 03:13:01.208716 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 396/814] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:00 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1513 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:01.382035 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3f2e1a24-432b-4b32-a9a4-1411fdb7a7ca tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:01.382561 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3f2e1a24-432b-4b32-a9a4-1411fdb7a7ca tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:01.390015 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3f2e1a24-432b-4b32-a9a4-1411fdb7a7ca tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.390696 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3f2e1a24-432b-4b32-a9a4-1411fdb7a7ca tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.391141 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3f2e1a24-432b-4b32-a9a4-1411fdb7a7ca tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.392049 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3f2e1a24-432b-4b32-a9a4-1411fdb7a7ca tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.392555 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3f2e1a24-432b-4b32-a9a4-1411fdb7a7ca tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.392970 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3f2e1a24-432b-4b32-a9a4-1411fdb7a7ca tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.481378 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-3f2e1a24-432b-4b32-a9a4-1411fdb7a7ca tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lazy-loading 'services' on Instance uuid 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:01.583585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-937eeb98-d1bf-45cb-8a76-25402693a245 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:01.584220 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-937eeb98-d1bf-45cb-8a76-25402693a245 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:01.591106 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-937eeb98-d1bf-45cb-8a76-25402693a245 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.591607 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-937eeb98-d1bf-45cb-8a76-25402693a245 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.592050 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-937eeb98-d1bf-45cb-8a76-25402693a245 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.592995 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-937eeb98-d1bf-45cb-8a76-25402693a245 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.593461 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-937eeb98-d1bf-45cb-8a76-25402693a245 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.593897 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-937eeb98-d1bf-45cb-8a76-25402693a245 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.710397 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3f2e1a24-432b-4b32-a9a4-1411fdb7a7ca tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "DELETE /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments/f1712f1e-c3cf-4b42-ae79-3a8abf96e667" status: 202 len: 0 microversion: 2.1 time: 0.332515 Oct 14 03:13:01.714542 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 419/815] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Oct 14 03:13:01 2022] DELETE /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments/f1712f1e-c3cf-4b42-ae79-3a8abf96e667 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:13:01.720208 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a1fd03ea-fa13-4d26-9ba5-4d84e4ab4abe tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:01.722636 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a1fd03ea-fa13-4d26-9ba5-4d84e4ab4abe tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:01.737806 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a1fd03ea-fa13-4d26-9ba5-4d84e4ab4abe tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.738989 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a1fd03ea-fa13-4d26-9ba5-4d84e4ab4abe tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.739593 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a1fd03ea-fa13-4d26-9ba5-4d84e4ab4abe tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.740546 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a1fd03ea-fa13-4d26-9ba5-4d84e4ab4abe tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.740993 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a1fd03ea-fa13-4d26-9ba5-4d84e4ab4abe tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.741425 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a1fd03ea-fa13-4d26-9ba5-4d84e4ab4abe tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.762562 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-937eeb98-d1bf-45cb-8a76-25402693a245 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:01.770922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-937eeb98-d1bf-45cb-8a76-25402693a245 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1557 microversion: 2.1 time: 0.191503 Oct 14 03:13:01.774458 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a1fd03ea-fa13-4d26-9ba5-4d84e4ab4abe tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058438 Oct 14 03:13:01.780772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 420/816] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:13:01 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:01.784658 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 397/817] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:01 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1557 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:01.795713 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-589f81fc-aa23-4acc-859c-b9a396b2ea70 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:01.796512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-589f81fc-aa23-4acc-859c-b9a396b2ea70 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:01.802448 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-589f81fc-aa23-4acc-859c-b9a396b2ea70 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.802933 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-589f81fc-aa23-4acc-859c-b9a396b2ea70 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.803370 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-589f81fc-aa23-4acc-859c-b9a396b2ea70 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.804076 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-589f81fc-aa23-4acc-859c-b9a396b2ea70 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.804681 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-589f81fc-aa23-4acc-859c-b9a396b2ea70 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.805108 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-589f81fc-aa23-4acc-859c-b9a396b2ea70 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.831602 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-b1d912c4-ece9-462c-b6a0-553e8bb7f5f3 req-792cad88-ba7b-4904-a190-0679a98b1999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c3606f-b3fb-4249-b5fd-a2de8f5debc2", "tag": "fcb4f2b3-a43c-4d79-98f7-46d493d8d296"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:01.842723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-b1d912c4-ece9-462c-b6a0-553e8bb7f5f3 req-792cad88-ba7b-4904-a190-0679a98b1999 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.843466 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-b1d912c4-ece9-462c-b6a0-553e8bb7f5f3 req-792cad88-ba7b-4904-a190-0679a98b1999 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.844061 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-b1d912c4-ece9-462c-b6a0-553e8bb7f5f3 req-792cad88-ba7b-4904-a190-0679a98b1999 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.861584 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-b1d912c4-ece9-462c-b6a0-553e8bb7f5f3 req-792cad88-ba7b-4904-a190-0679a98b1999 service nova] Creating event network-changed:fcb4f2b3-a43c-4d79-98f7-46d493d8d296 for instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 on hv-cinder-80152 Oct 14 03:13:01.872242 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-b1d912c4-ece9-462c-b6a0-553e8bb7f5f3 req-792cad88-ba7b-4904-a190-0679a98b1999 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043671 Oct 14 03:13:01.876979 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 398/818] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:01.897962 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-589f81fc-aa23-4acc-859c-b9a396b2ea70 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106620 Oct 14 03:13:01.898558 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 421/819] 10.222.0.13 () {58 vars in 1275 bytes} [Fri Oct 14 03:13:01 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:02.233361 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-41c905a1-eee0-4ffd-901e-48acc51e6129 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:02.236345 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-41c905a1-eee0-4ffd-901e-48acc51e6129 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:02.245387 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-41c905a1-eee0-4ffd-901e-48acc51e6129 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:02.246393 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-41c905a1-eee0-4ffd-901e-48acc51e6129 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:02.247764 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-41c905a1-eee0-4ffd-901e-48acc51e6129 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:02.248795 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-41c905a1-eee0-4ffd-901e-48acc51e6129 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:02.249590 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-41c905a1-eee0-4ffd-901e-48acc51e6129 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:02.250439 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-41c905a1-eee0-4ffd-901e-48acc51e6129 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:02.433177 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-41c905a1-eee0-4ffd-901e-48acc51e6129 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:02.443851 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-41c905a1-eee0-4ffd-901e-48acc51e6129 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1513 microversion: 2.1 time: 0.216567 Oct 14 03:13:02.444606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 399/820] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:02 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1513 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:02.788351 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5b19ada1-4833-45e5-a06d-2f08a22e1bea tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:02.790448 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5b19ada1-4833-45e5-a06d-2f08a22e1bea tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:02.797878 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5b19ada1-4833-45e5-a06d-2f08a22e1bea tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:02.798407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5b19ada1-4833-45e5-a06d-2f08a22e1bea tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:02.799061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5b19ada1-4833-45e5-a06d-2f08a22e1bea tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:02.799950 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5b19ada1-4833-45e5-a06d-2f08a22e1bea tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:02.800594 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5b19ada1-4833-45e5-a06d-2f08a22e1bea tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:02.801180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5b19ada1-4833-45e5-a06d-2f08a22e1bea tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:02.834305 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5b19ada1-4833-45e5-a06d-2f08a22e1bea tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050554 Oct 14 03:13:02.834894 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 422/821] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:13:02 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:13:03.248794 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-1852897f-d9f4-4ce3-aa2f-7f065c867b6f req-745c5897-dc67-44a7-985e-98598815f441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d", "tag": "06fd51ef-122c-4339-9704-90cd3f5bc8b9"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:03.259099 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-1852897f-d9f4-4ce3-aa2f-7f065c867b6f req-745c5897-dc67-44a7-985e-98598815f441 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:03.260026 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-1852897f-d9f4-4ce3-aa2f-7f065c867b6f req-745c5897-dc67-44a7-985e-98598815f441 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:03.260640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-1852897f-d9f4-4ce3-aa2f-7f065c867b6f req-745c5897-dc67-44a7-985e-98598815f441 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:03.272277 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-1852897f-d9f4-4ce3-aa2f-7f065c867b6f req-745c5897-dc67-44a7-985e-98598815f441 service nova] Creating event network-changed:06fd51ef-122c-4339-9704-90cd3f5bc8b9 for instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d on hv-cinder-80152 Oct 14 03:13:03.277718 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-1852897f-d9f4-4ce3-aa2f-7f065c867b6f req-745c5897-dc67-44a7-985e-98598815f441 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033042 Oct 14 03:13:03.278315 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 400/822] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:03.471478 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-925df23d-7580-41d4-855e-99cb4b0b6860 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:03.472227 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-925df23d-7580-41d4-855e-99cb4b0b6860 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:03.478117 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-925df23d-7580-41d4-855e-99cb4b0b6860 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:03.479094 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-925df23d-7580-41d4-855e-99cb4b0b6860 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:03.479094 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-925df23d-7580-41d4-855e-99cb4b0b6860 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:03.479770 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-925df23d-7580-41d4-855e-99cb4b0b6860 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:03.480218 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-925df23d-7580-41d4-855e-99cb4b0b6860 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:03.480742 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-925df23d-7580-41d4-855e-99cb4b0b6860 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:03.619962 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-925df23d-7580-41d4-855e-99cb4b0b6860 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:03.628073 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-925df23d-7580-41d4-855e-99cb4b0b6860 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1513 microversion: 2.1 time: 0.161231 Oct 14 03:13:03.636186 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 423/823] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:03 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:03.825729 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d2413a90-b476-48c9-8eb8-75a292a1c51e tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Action: 'create', calling method: .version_select at 0x7fdcc75554c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1895242415", "metadata": {"Type": "work"}}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d2413a90-b476-48c9-8eb8-75a292a1c51e tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Request method failure captured: Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 122 Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNO_wAiIerrpbbCqV6RYL-3YY-iB_94s5-otgu_pQ2UVDKyhKHWFy0fEnfpPv5I3dQLejq3PkeVnSkDdkBN4HGo1AJ6xPzqkMjmaRp3f84l2b5bshlVPcQ7IcFkdWY29PSN9z6JhFl4eH1aEEIHbXsntDv2ff-HPecohsFqd_lRC1gw Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 2e229b5e4a3448fab14d3972ff247a14 Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:13:03.834311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:13:03.835847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:13:03.835847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.835847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 2e229b5e4a3448fab14d3972ff247a14 Oct 14 03:13:03.835847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.835847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-VolumesNegativeTest-1588625695-project Oct 14 03:13:03.835847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:13:03.835847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:13:03.835847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 83b3009fba0d49768891fe692f7da1c8 Oct 14 03:13:03.835847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-VolumesNegativeTest-1588625695-project Oct 14 03:13:03.835847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Oct 14 03:13:03.835847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1895242415", "metadata": {"Type": "work"}}} Oct 14 03:13:03.835847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: Oct 14 03:13:03.835847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1895242415', 'metadata': {'Type': 'work'}}}} Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise error Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi '#$%' Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:03.836865 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 14 03:13:03.838420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 14 03:13:03.839934 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 14 03:13:03.839934 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.839934 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d2413a90-b476-48c9-8eb8-75a292a1c51e tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:03.839934 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d2413a90-b476-48c9-8eb8-75a292a1c51e tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.129295 Oct 14 03:13:03.839934 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 401/824] 10.222.0.13 () {60 vars in 1156 bytes} [Fri Oct 14 03:13:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:13:03.848622 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-940e0e14-0827-43ba-b56b-a6658e1aff34 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Action: 'create', calling method: .version_select at 0x7fdcc73f4af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1179315924", "metadata": {"Type": "work"}}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:03.848785 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-6edbb20e-8242-46b6-9783-9c1a964750c6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:03.850801 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-6edbb20e-8242-46b6-9783-9c1a964750c6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-940e0e14-0827-43ba-b56b-a6658e1aff34 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Request method failure captured: Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 120 Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNO_wAiIerrpbbCqV6RYL-3YY-iB_94s5-otgu_pQ2UVDKyhKHWFy0fEnfpPv5I3dQLejq3PkeVnSkDdkBN4HGo1AJ6xPzqkMjmaRp3f84l2b5bshlVPcQ7IcFkdWY29PSN9z6JhFl4eH1aEEIHbXsntDv2ff-HPecohsFqd_lRC1gw Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 2e229b5e4a3448fab14d3972ff247a14 Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:13:03.854438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:13:03.856004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:13:03.856004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.856004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 2e229b5e4a3448fab14d3972ff247a14 Oct 14 03:13:03.856004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.856004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-VolumesNegativeTest-1588625695-project Oct 14 03:13:03.856004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:13:03.856004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:13:03.856004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 83b3009fba0d49768891fe692f7da1c8 Oct 14 03:13:03.856004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-VolumesNegativeTest-1588625695-project Oct 14 03:13:03.856004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Oct 14 03:13:03.856004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1179315924", "metadata": {"Type": "work"}}} Oct 14 03:13:03.856004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: Oct 14 03:13:03.856004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1179315924', 'metadata': {'Type': 'work'}}}} Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise error Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi '0' Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:03.856984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 14 03:13:03.858570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 14 03:13:03.859898 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 14 03:13:03.859898 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.859898 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-940e0e14-0827-43ba-b56b-a6658e1aff34 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:03.860128 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6edbb20e-8242-46b6-9783-9c1a964750c6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:03.860128 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6edbb20e-8242-46b6-9783-9c1a964750c6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:03.860303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-940e0e14-0827-43ba-b56b-a6658e1aff34 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012815 Oct 14 03:13:03.860453 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6edbb20e-8242-46b6-9783-9c1a964750c6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:03.860453 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6edbb20e-8242-46b6-9783-9c1a964750c6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:03.860453 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6edbb20e-8242-46b6-9783-9c1a964750c6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:03.860691 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 402/825] 10.222.0.13 () {60 vars in 1156 bytes} [Fri Oct 14 03:13:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:13:03.862038 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6edbb20e-8242-46b6-9783-9c1a964750c6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:03.868785 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-342f78ab-0844-42c2-8c81-70cc6ed51d31 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Action: 'create', calling method: .version_select at 0x7fdcc747eb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1601721861", "metadata": {"Type": "work"}}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-342f78ab-0844-42c2-8c81-70cc6ed51d31 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Request method failure captured: Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 119 Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNO_wAiIerrpbbCqV6RYL-3YY-iB_94s5-otgu_pQ2UVDKyhKHWFy0fEnfpPv5I3dQLejq3PkeVnSkDdkBN4HGo1AJ6xPzqkMjmaRp3f84l2b5bshlVPcQ7IcFkdWY29PSN9z6JhFl4eH1aEEIHbXsntDv2ff-HPecohsFqd_lRC1gw Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 2e229b5e4a3448fab14d3972ff247a14 Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:13:03.874774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:13:03.876796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:13:03.876796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.876796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 2e229b5e4a3448fab14d3972ff247a14 Oct 14 03:13:03.876796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.876796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-VolumesNegativeTest-1588625695-project Oct 14 03:13:03.876796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:13:03.876796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:13:03.876796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 83b3009fba0d49768891fe692f7da1c8 Oct 14 03:13:03.876796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-VolumesNegativeTest-1588625695-project Oct 14 03:13:03.876796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Oct 14 03:13:03.876796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1601721861", "metadata": {"Type": "work"}}} Oct 14 03:13:03.876796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: Oct 14 03:13:03.876796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1601721861', 'metadata': {'Type': 'work'}}}} Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise error Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi '' Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:03.877720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 14 03:13:03.879175 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 14 03:13:03.880587 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 14 03:13:03.880587 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.880587 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-342f78ab-0844-42c2-8c81-70cc6ed51d31 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:03.880587 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-342f78ab-0844-42c2-8c81-70cc6ed51d31 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009355 Oct 14 03:13:03.881565 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 403/826] 10.222.0.13 () {60 vars in 1156 bytes} [Fri Oct 14 03:13:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 14 03:13:03.885875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-bb1bdce1-8c53-4edb-9a63-4a79d020813f tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Calling method '.version_select at 0x7fdcc74339d0>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:03.900131 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-6edbb20e-8242-46b6-9783-9c1a964750c6 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055299 Oct 14 03:13:03.901072 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 424/827] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:13:03 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:03.918094 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-bb1bdce1-8c53-4edb-9a63-4a79d020813f tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] HTTP exception thrown: Volume tempest-invalid-600924052 could not be found. Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-bb1bdce1-8c53-4edb-9a63-4a79d020813f tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Request method failure captured: Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-600924052 HTTP/1.1 Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNO_wAiIerrpbbCqV6RYL-3YY-iB_94s5-otgu_pQ2UVDKyhKHWFy0fEnfpPv5I3dQLejq3PkeVnSkDdkBN4HGo1AJ6xPzqkMjmaRp3f84l2b5bshlVPcQ7IcFkdWY29PSN9z6JhFl4eH1aEEIHbXsntDv2ff-HPecohsFqd_lRC1gw Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 2e229b5e4a3448fab14d3972ff247a14 Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:13:03.921423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:13:03.923036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:13:03.923036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.923036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 2e229b5e4a3448fab14d3972ff247a14 Oct 14 03:13:03.923036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.923036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-VolumesNegativeTest-1588625695-project Oct 14 03:13:03.923036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:13:03.923036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:13:03.923036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 83b3009fba0d49768891fe692f7da1c8 Oct 14 03:13:03.923036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-VolumesNegativeTest-1588625695-project Oct 14 03:13:03.923036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: Oct 14 03:13:03.923036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Volume tempest-invalid-600924052 could not be found. Oct 14 03:13:03.923036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': 'tempest-invalid-600924052'} Oct 14 03:13:03.923036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-600924052 could not be found. (HTTP 404) (Request-ID: req-6debad4a-cbe5-45fc-8240-626c1f22d737) Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:03.923971 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 03:13:03.925366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-600924052 could not be found. Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:03.926758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-600924052 could not be found. Oct 14 03:13:03.928034 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.928034 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:03.928034 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.928034 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.928034 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:03.928034 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:03.928034 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:03.928034 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:03.928034 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-600924052 could not be found. Oct 14 03:13:03.928034 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.928034 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-bb1bdce1-8c53-4edb-9a63-4a79d020813f tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Returning 404 to user: Volume tempest-invalid-600924052 could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:03.928034 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-bb1bdce1-8c53-4edb-9a63-4a79d020813f tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-600924052" status: 404 len: 98 microversion: 2.1 time: 0.040599 Oct 14 03:13:03.928927 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 404/828] 10.222.0.13 () {58 vars in 1215 bytes} [Fri Oct 14 03:13:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-600924052 => generated 98 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 14 03:13:03.933780 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-adcde552-1a38-4b9d-9ccd-085add6714b2 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003753 Oct 14 03:13:03.934349 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 425/829] 10.222.0.13 () {58 vars in 1140 bytes} [Fri Oct 14 03:13:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 14 03:13:03.942878 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-83958c30-843d-4685-8a5a-6f8506cff9f4 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003747 Oct 14 03:13:03.943381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 405/830] 10.222.0.13 () {58 vars in 1137 bytes} [Fri Oct 14 03:13:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 14 03:13:03.952835 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-dd31f033-15ac-483c-991f-180edeb6d002 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Calling method '.version_select at 0x7fdcc757d790>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:03.982419 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-dd31f033-15ac-483c-991f-180edeb6d002 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] HTTP exception thrown: Volume 47a63f29-116a-457f-9a29-92a31448316b could not be found. Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-dd31f033-15ac-483c-991f-180edeb6d002 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Request method failure captured: Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: DELETE /compute/v2.1/os-volumes/47a63f29-116a-457f-9a29-92a31448316b HTTP/1.1 Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNO_wAiIerrpbbCqV6RYL-3YY-iB_94s5-otgu_pQ2UVDKyhKHWFy0fEnfpPv5I3dQLejq3PkeVnSkDdkBN4HGo1AJ6xPzqkMjmaRp3f84l2b5bshlVPcQ7IcFkdWY29PSN9z6JhFl4eH1aEEIHbXsntDv2ff-HPecohsFqd_lRC1gw Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 2e229b5e4a3448fab14d3972ff247a14 Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:13:03.984508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:13:03.986099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:13:03.986099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.986099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 2e229b5e4a3448fab14d3972ff247a14 Oct 14 03:13:03.986099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:03.986099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-VolumesNegativeTest-1588625695-project Oct 14 03:13:03.986099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:13:03.986099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:13:03.986099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 83b3009fba0d49768891fe692f7da1c8 Oct 14 03:13:03.986099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-VolumesNegativeTest-1588625695-project Oct 14 03:13:03.986099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: Oct 14 03:13:03.986099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Volume 47a63f29-116a-457f-9a29-92a31448316b could not be found. Oct 14 03:13:03.986099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '47a63f29-116a-457f-9a29-92a31448316b'} Oct 14 03:13:03.986099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 47a63f29-116a-457f-9a29-92a31448316b could not be found. (HTTP 404) (Request-ID: req-0112d149-ed0d-466b-a862-021b4f379249) Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:03.987011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 03:13:03.988375 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 47a63f29-116a-457f-9a29-92a31448316b could not be found. Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 14 03:13:03.989793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:03.991189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 47a63f29-116a-457f-9a29-92a31448316b could not be found. Oct 14 03:13:03.991189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.991189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:03.991189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.991189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.991189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:03.991189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:03.991189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:03.991189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:03.991189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 47a63f29-116a-457f-9a29-92a31448316b could not be found. Oct 14 03:13:03.991189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.991189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-dd31f033-15ac-483c-991f-180edeb6d002 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Returning 404 to user: Volume 47a63f29-116a-457f-9a29-92a31448316b could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:03.991189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-dd31f033-15ac-483c-991f-180edeb6d002 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/47a63f29-116a-457f-9a29-92a31448316b" status: 404 len: 109 microversion: 2.1 time: 0.037584 Oct 14 03:13:03.991189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 426/831] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Oct 14 03:13:03 2022] DELETE /compute/v2.1/os-volumes/47a63f29-116a-457f-9a29-92a31448316b => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:03.992616 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=10 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:03.996582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0ea9f100-80fe-407c-a6b9-555ad701a182 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Calling method '.version_select at 0x7fdcc74331f0>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:04.025810 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-0ea9f100-80fe-407c-a6b9-555ad701a182 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] HTTP exception thrown: Volume 58266ea7-6676-41c5-a502-66450642775f could not be found. Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0ea9f100-80fe-407c-a6b9-555ad701a182 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Request method failure captured: Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/os-volumes/58266ea7-6676-41c5-a502-66450642775f HTTP/1.1 Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNO_wAiIerrpbbCqV6RYL-3YY-iB_94s5-otgu_pQ2UVDKyhKHWFy0fEnfpPv5I3dQLejq3PkeVnSkDdkBN4HGo1AJ6xPzqkMjmaRp3f84l2b5bshlVPcQ7IcFkdWY29PSN9z6JhFl4eH1aEEIHbXsntDv2ff-HPecohsFqd_lRC1gw Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 2e229b5e4a3448fab14d3972ff247a14 Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:13:04.028457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:13:04.029784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2e229b5e4a3448fab14d3972ff247a14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:13:04.029784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:04.029784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 2e229b5e4a3448fab14d3972ff247a14 Oct 14 03:13:04.029784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-VolumesNegativeTest-1588625695 Oct 14 03:13:04.029784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-VolumesNegativeTest-1588625695-project Oct 14 03:13:04.029784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:13:04.029784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:13:04.029784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 83b3009fba0d49768891fe692f7da1c8 Oct 14 03:13:04.029784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-VolumesNegativeTest-1588625695-project Oct 14 03:13:04.029784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: Oct 14 03:13:04.029784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Volume 58266ea7-6676-41c5-a502-66450642775f could not be found. Oct 14 03:13:04.029784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': '58266ea7-6676-41c5-a502-66450642775f'} Oct 14 03:13:04.029784 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58266ea7-6676-41c5-a502-66450642775f could not be found. (HTTP 404) (Request-ID: req-3f7c2c25-a01c-42f7-b771-3d8e2cd64da3) Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:04.030582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:13:04.032036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58266ea7-6676-41c5-a502-66450642775f could not be found. Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 03:13:04.033882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:04.035269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58266ea7-6676-41c5-a502-66450642775f could not be found. Oct 14 03:13:04.035269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:04.035269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:04.035269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:04.035269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:04.035269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:04.035269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:04.035269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:04.035269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:04.035269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58266ea7-6676-41c5-a502-66450642775f could not be found. Oct 14 03:13:04.035269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:04.035269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0ea9f100-80fe-407c-a6b9-555ad701a182 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] Returning 404 to user: Volume 58266ea7-6676-41c5-a502-66450642775f could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:04.035269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-0ea9f100-80fe-407c-a6b9-555ad701a182 tempest-VolumesNegativeTest-1588625695 tempest-VolumesNegativeTest-1588625695-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/58266ea7-6676-41c5-a502-66450642775f" status: 404 len: 109 microversion: 2.1 time: 0.038082 Oct 14 03:13:04.035269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 406/832] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:03 2022] GET /compute/v2.1/os-volumes/58266ea7-6676-41c5-a502-66450642775f => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:04.651367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c0e3b37c-ce63-4b2d-bab0-591794f59cd5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:04.651795 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c0e3b37c-ce63-4b2d-bab0-591794f59cd5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:04.658818 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c0e3b37c-ce63-4b2d-bab0-591794f59cd5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:04.659308 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c0e3b37c-ce63-4b2d-bab0-591794f59cd5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:04.659759 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c0e3b37c-ce63-4b2d-bab0-591794f59cd5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:04.660496 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c0e3b37c-ce63-4b2d-bab0-591794f59cd5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:04.660961 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c0e3b37c-ce63-4b2d-bab0-591794f59cd5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:04.661391 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c0e3b37c-ce63-4b2d-bab0-591794f59cd5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:04.831996 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c0e3b37c-ce63-4b2d-bab0-591794f59cd5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:04.839881 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c0e3b37c-ce63-4b2d-bab0-591794f59cd5 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1513 microversion: 2.1 time: 0.192688 Oct 14 03:13:04.847175 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 427/833] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:04 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:04.915855 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ac0e7169-9dc4-4fd4-97ed-dacfe1d95e5d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:04.918097 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ac0e7169-9dc4-4fd4-97ed-dacfe1d95e5d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:04.925182 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ac0e7169-9dc4-4fd4-97ed-dacfe1d95e5d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:04.925670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ac0e7169-9dc4-4fd4-97ed-dacfe1d95e5d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:04.926109 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ac0e7169-9dc4-4fd4-97ed-dacfe1d95e5d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:04.926803 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ac0e7169-9dc4-4fd4-97ed-dacfe1d95e5d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:04.927259 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ac0e7169-9dc4-4fd4-97ed-dacfe1d95e5d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:04.927688 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ac0e7169-9dc4-4fd4-97ed-dacfe1d95e5d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:04.955886 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ac0e7169-9dc4-4fd4-97ed-dacfe1d95e5d tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045737 Oct 14 03:13:04.956468 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 407/834] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:13:04 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:05.863266 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b938fcf8-753c-4288-b7b0-ad485aa83306 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:05.863880 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b938fcf8-753c-4288-b7b0-ad485aa83306 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:05.870278 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b938fcf8-753c-4288-b7b0-ad485aa83306 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:05.870758 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b938fcf8-753c-4288-b7b0-ad485aa83306 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:05.871201 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b938fcf8-753c-4288-b7b0-ad485aa83306 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:05.871886 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b938fcf8-753c-4288-b7b0-ad485aa83306 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:05.872344 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b938fcf8-753c-4288-b7b0-ad485aa83306 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:05.872794 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b938fcf8-753c-4288-b7b0-ad485aa83306 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:05.969671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-762747ef-05c5-4d84-b6be-bef9a58e060e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:05.973365 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-762747ef-05c5-4d84-b6be-bef9a58e060e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:05.984087 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-762747ef-05c5-4d84-b6be-bef9a58e060e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:05.984822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-762747ef-05c5-4d84-b6be-bef9a58e060e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:05.985444 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-762747ef-05c5-4d84-b6be-bef9a58e060e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:05.986485 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-762747ef-05c5-4d84-b6be-bef9a58e060e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:05.988748 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-762747ef-05c5-4d84-b6be-bef9a58e060e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:05.989360 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-762747ef-05c5-4d84-b6be-bef9a58e060e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:06.019058 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b938fcf8-753c-4288-b7b0-ad485aa83306 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:06.024091 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-762747ef-05c5-4d84-b6be-bef9a58e060e tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059387 Oct 14 03:13:06.024835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 408/835] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:13:05 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:13:06.031629 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b938fcf8-753c-4288-b7b0-ad485aa83306 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1513 microversion: 2.1 time: 0.172199 Oct 14 03:13:06.032293 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 428/836] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:05 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:07.037592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-fc6f480a-5f5a-4025-a304-c20fe3fb9315 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:07.040420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-fc6f480a-5f5a-4025-a304-c20fe3fb9315 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:07.047325 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc6f480a-5f5a-4025-a304-c20fe3fb9315 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:07.047821 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc6f480a-5f5a-4025-a304-c20fe3fb9315 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:07.048267 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc6f480a-5f5a-4025-a304-c20fe3fb9315 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:07.049012 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc6f480a-5f5a-4025-a304-c20fe3fb9315 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:07.049467 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc6f480a-5f5a-4025-a304-c20fe3fb9315 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:07.050068 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc6f480a-5f5a-4025-a304-c20fe3fb9315 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:07.054894 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5c9f47b3-2f50-4905-9d81-976f12b923a6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:07.055930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5c9f47b3-2f50-4905-9d81-976f12b923a6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:07.063080 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5c9f47b3-2f50-4905-9d81-976f12b923a6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:07.063637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5c9f47b3-2f50-4905-9d81-976f12b923a6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:07.064324 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5c9f47b3-2f50-4905-9d81-976f12b923a6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:07.065428 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5c9f47b3-2f50-4905-9d81-976f12b923a6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:07.066316 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5c9f47b3-2f50-4905-9d81-976f12b923a6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:07.067397 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5c9f47b3-2f50-4905-9d81-976f12b923a6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:07.080471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-fc6f480a-5f5a-4025-a304-c20fe3fb9315 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046915 Oct 14 03:13:07.086608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 409/837] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:13:07 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:13:07.093539 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3ac86537-5b8f-479d-b0a1-0b8677cd73c5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:07.094061 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-3ac86537-5b8f-479d-b0a1-0b8677cd73c5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:07.101130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3ac86537-5b8f-479d-b0a1-0b8677cd73c5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:07.104046 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3ac86537-5b8f-479d-b0a1-0b8677cd73c5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:07.104046 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3ac86537-5b8f-479d-b0a1-0b8677cd73c5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:07.104046 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3ac86537-5b8f-479d-b0a1-0b8677cd73c5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:07.104046 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3ac86537-5b8f-479d-b0a1-0b8677cd73c5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:07.104581 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3ac86537-5b8f-479d-b0a1-0b8677cd73c5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:07.193100 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-3ac86537-5b8f-479d-b0a1-0b8677cd73c5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] HTTP exception thrown: Instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 is not attached to volume f1712f1e-c3cf-4b42-ae79-3a8abf96e667 Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3ac86537-5b8f-479d-b0a1-0b8677cd73c5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Request method failure captured: Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: DELETE /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments/f1712f1e-c3cf-4b42-ae79-3a8abf96e667 HTTP/1.1 Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNL49v_Cf3OuoDpTtyLbZ0J0mcmbb6ZzSiMzmHzDrWK3jeT8tEj9aDqGotGby4nWeNk6lKpqiCwo1XTQz_zSw7gF5bplqC-wbf5cg9tLXb_bzVSjlzU8MeDhDF8mp05apqCrhr8Pv3JE9pMxenoidAqWqsyXKmrgGLt4GcNEBuwKd30 Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 709ccf636093493093e88488ce49484f Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-TestMinimumBasicScenario-116381281 Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:13:07.200756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:13:07.202481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/709ccf636093493093e88488ce49484f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/709ccf636093493093e88488ce49484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/709ccf636093493093e88488ce49484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_709ccf636093493093e88488ce49484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:13:07.202481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-TestMinimumBasicScenario-116381281 Oct 14 03:13:07.202481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 709ccf636093493093e88488ce49484f Oct 14 03:13:07.202481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-TestMinimumBasicScenario-116381281 Oct 14 03:13:07.202481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-TestMinimumBasicScenario-116381281-project Oct 14 03:13:07.202481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:13:07.202481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:13:07.202481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: c79116777e354734b73a0b334fd013c9 Oct 14 03:13:07.202481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-TestMinimumBasicScenario-116381281-project Oct 14 03:13:07.202481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:13:07.202481 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 is not attached to volume f1712f1e-c3cf-4b42-ae79-3a8abf96e667 Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'server_id': '93c3606f-b3fb-4249-b5fd-a2de8f5debc2', 'id': 'f1712f1e-c3cf-4b42-ae79-3a8abf96e667'} Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f1712f1e-c3cf-4b42-ae79-3a8abf96e667. Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:07.203190 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 is not attached to volume f1712f1e-c3cf-4b42-ae79-3a8abf96e667 Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 is not attached to volume f1712f1e-c3cf-4b42-ae79-3a8abf96e667 Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:07.204364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3ac86537-5b8f-479d-b0a1-0b8677cd73c5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Returning 404 to user: Instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 is not attached to volume f1712f1e-c3cf-4b42-ae79-3a8abf96e667 {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:07.207810 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-3ac86537-5b8f-479d-b0a1-0b8677cd73c5 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "DELETE /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments/f1712f1e-c3cf-4b42-ae79-3a8abf96e667" status: 404 len: 154 microversion: 2.1 time: 0.111088 Oct 14 03:13:07.207810 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 410/838] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Oct 14 03:13:07 2022] DELETE /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2/os-volume_attachments/f1712f1e-c3cf-4b42-ae79-3a8abf96e667 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:07.271217 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5c9f47b3-2f50-4905-9d81-976f12b923a6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:07.281584 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5c9f47b3-2f50-4905-9d81-976f12b923a6 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1513 microversion: 2.1 time: 0.230579 Oct 14 03:13:07.282094 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 429/839] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:07 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:07.711559 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-96e460c0-dd2d-4ead-b481-452996dc794a req-048a1f9a-8522-410a-8e0f-b4e28c0610af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec35719e-f7e5-4961-b289-277efae29da5", "name": "network-vif-deleted", "tag": "0af7a28a-8080-43f0-91ce-95c4a14e9eb5"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:07.722333 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-96e460c0-dd2d-4ead-b481-452996dc794a req-048a1f9a-8522-410a-8e0f-b4e28c0610af service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:07.722889 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-96e460c0-dd2d-4ead-b481-452996dc794a req-048a1f9a-8522-410a-8e0f-b4e28c0610af service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:07.723403 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-96e460c0-dd2d-4ead-b481-452996dc794a req-048a1f9a-8522-410a-8e0f-b4e28c0610af service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:07.735470 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-96e460c0-dd2d-4ead-b481-452996dc794a req-048a1f9a-8522-410a-8e0f-b4e28c0610af service nova] Creating event network-vif-deleted:0af7a28a-8080-43f0-91ce-95c4a14e9eb5 for instance ec35719e-f7e5-4961-b289-277efae29da5 on hv-cinder-80152 Oct 14 03:13:07.740732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-96e460c0-dd2d-4ead-b481-452996dc794a req-048a1f9a-8522-410a-8e0f-b4e28c0610af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032890 Oct 14 03:13:07.741251 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 411/840] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:08.305539 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9e6a00bd-ea16-4a7c-ab7b-d7cd76abe418 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:08.307538 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-9e6a00bd-ea16-4a7c-ab7b-d7cd76abe418 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:08.315802 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9e6a00bd-ea16-4a7c-ab7b-d7cd76abe418 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:08.316685 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9e6a00bd-ea16-4a7c-ab7b-d7cd76abe418 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:08.317307 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9e6a00bd-ea16-4a7c-ab7b-d7cd76abe418 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:08.318362 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9e6a00bd-ea16-4a7c-ab7b-d7cd76abe418 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:08.319254 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9e6a00bd-ea16-4a7c-ab7b-d7cd76abe418 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:08.319851 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9e6a00bd-ea16-4a7c-ab7b-d7cd76abe418 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:08.353976 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9e6a00bd-ea16-4a7c-ab7b-d7cd76abe418 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:08.354470 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9e6a00bd-ea16-4a7c-ab7b-d7cd76abe418 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:08.354910 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9e6a00bd-ea16-4a7c-ab7b-d7cd76abe418 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:08.355359 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-9e6a00bd-ea16-4a7c-ab7b-d7cd76abe418 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lazy-loading 'fault' on Instance uuid ec35719e-f7e5-4961-b289-277efae29da5 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:08.408891 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-9e6a00bd-ea16-4a7c-ab7b-d7cd76abe418 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:08.417147 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9e6a00bd-ea16-4a7c-ab7b-d7cd76abe418 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1308 microversion: 2.1 time: 0.115611 Oct 14 03:13:08.417698 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 430/841] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:08 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:08.530364 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e9b22222-bb68-40d4-94ac-f75410c8c81c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:08.530952 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e9b22222-bb68-40d4-94ac-f75410c8c81c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:08.537100 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e9b22222-bb68-40d4-94ac-f75410c8c81c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:08.537585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e9b22222-bb68-40d4-94ac-f75410c8c81c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:08.538019 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e9b22222-bb68-40d4-94ac-f75410c8c81c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:08.538712 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e9b22222-bb68-40d4-94ac-f75410c8c81c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:08.539169 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e9b22222-bb68-40d4-94ac-f75410c8c81c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:08.539592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e9b22222-bb68-40d4-94ac-f75410c8c81c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:08.565877 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e9b22222-bb68-40d4-94ac-f75410c8c81c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Going to try to terminate instance {{(pid=119302) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:13:08.597122 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:08.811521 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e9b22222-bb68-40d4-94ac-f75410c8c81c tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "DELETE /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 204 len: 0 microversion: 2.1 time: 0.285383 Oct 14 03:13:08.812256 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 412/842] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:13:08 2022] DELETE /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:13:08.820590 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-40d52c0f-6152-44f0-9588-9aeb0b433f45 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:08.821204 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-40d52c0f-6152-44f0-9588-9aeb0b433f45 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:08.827184 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-40d52c0f-6152-44f0-9588-9aeb0b433f45 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:08.827672 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-40d52c0f-6152-44f0-9588-9aeb0b433f45 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:08.828114 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-40d52c0f-6152-44f0-9588-9aeb0b433f45 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:08.828833 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-40d52c0f-6152-44f0-9588-9aeb0b433f45 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:08.829293 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-40d52c0f-6152-44f0-9588-9aeb0b433f45 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:08.829721 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-40d52c0f-6152-44f0-9588-9aeb0b433f45 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:09.013175 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-40d52c0f-6152-44f0-9588-9aeb0b433f45 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:09.021643 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-40d52c0f-6152-44f0-9588-9aeb0b433f45 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1552 microversion: 2.1 time: 0.204942 Oct 14 03:13:09.022403 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 431/843] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:08 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1552 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:09.444017 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8b110fd3-b941-4317-a447-9b371fad0467 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:09.444745 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8b110fd3-b941-4317-a447-9b371fad0467 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:09.451936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8b110fd3-b941-4317-a447-9b371fad0467 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:09.452456 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8b110fd3-b941-4317-a447-9b371fad0467 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:09.452933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8b110fd3-b941-4317-a447-9b371fad0467 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:09.453632 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8b110fd3-b941-4317-a447-9b371fad0467 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:09.454123 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8b110fd3-b941-4317-a447-9b371fad0467 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:09.454556 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8b110fd3-b941-4317-a447-9b371fad0467 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:09.486768 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8b110fd3-b941-4317-a447-9b371fad0467 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:09.487299 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8b110fd3-b941-4317-a447-9b371fad0467 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:09.487700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8b110fd3-b941-4317-a447-9b371fad0467 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:09.488130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-8b110fd3-b941-4317-a447-9b371fad0467 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lazy-loading 'fault' on Instance uuid ec35719e-f7e5-4961-b289-277efae29da5 {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:09.561464 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8b110fd3-b941-4317-a447-9b371fad0467 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:09.569088 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8b110fd3-b941-4317-a447-9b371fad0467 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1308 microversion: 2.1 time: 0.129386 Oct 14 03:13:09.569678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 413/844] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:09 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1308 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:10.045746 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-77f16c27-8231-4412-9724-212bb3aabf4b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:10.046382 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-77f16c27-8231-4412-9724-212bb3aabf4b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:10.052841 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77f16c27-8231-4412-9724-212bb3aabf4b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:10.053322 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77f16c27-8231-4412-9724-212bb3aabf4b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:10.053763 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77f16c27-8231-4412-9724-212bb3aabf4b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:10.054454 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77f16c27-8231-4412-9724-212bb3aabf4b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:10.054907 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77f16c27-8231-4412-9724-212bb3aabf4b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:10.055330 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-77f16c27-8231-4412-9724-212bb3aabf4b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:10.199583 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-77f16c27-8231-4412-9724-212bb3aabf4b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:10.208600 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-77f16c27-8231-4412-9724-212bb3aabf4b tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1552 microversion: 2.1 time: 0.167253 Oct 14 03:13:10.211749 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 432/845] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:10 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:10.593246 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6a8695c1-ce84-4ee4-9775-e727b4fe3f89 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:10.593887 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6a8695c1-ce84-4ee4-9775-e727b4fe3f89 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:10.600206 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6a8695c1-ce84-4ee4-9775-e727b4fe3f89 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:10.600717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6a8695c1-ce84-4ee4-9775-e727b4fe3f89 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:10.601155 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6a8695c1-ce84-4ee4-9775-e727b4fe3f89 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:10.601846 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6a8695c1-ce84-4ee4-9775-e727b4fe3f89 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:10.602335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6a8695c1-ce84-4ee4-9775-e727b4fe3f89 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:10.602754 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6a8695c1-ce84-4ee4-9775-e727b4fe3f89 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:10.794711 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6a8695c1-ce84-4ee4-9775-e727b4fe3f89 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:10.795227 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6a8695c1-ce84-4ee4-9775-e727b4fe3f89 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:10.795669 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6a8695c1-ce84-4ee4-9775-e727b4fe3f89 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:10.796113 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-6a8695c1-ce84-4ee4-9775-e727b4fe3f89 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lazy-loading 'fault' on Instance uuid ec35719e-f7e5-4961-b289-277efae29da5 {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:11.080006 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6a8695c1-ce84-4ee4-9775-e727b4fe3f89 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7175a36794194edba6b16366b0e12a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf6f8c0f3694f42a30232874a142685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:11.087335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6a8695c1-ce84-4ee4-9775-e727b4fe3f89 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 200 len: 1308 microversion: 2.1 time: 0.498723 Oct 14 03:13:11.087905 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 414/846] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:10 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 1308 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:11.233893 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5e35e1bf-770b-4899-a393-80258d5f9593 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:11.234504 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5e35e1bf-770b-4899-a393-80258d5f9593 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:11.241606 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5e35e1bf-770b-4899-a393-80258d5f9593 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:11.242104 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5e35e1bf-770b-4899-a393-80258d5f9593 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:11.242547 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5e35e1bf-770b-4899-a393-80258d5f9593 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:11.243258 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5e35e1bf-770b-4899-a393-80258d5f9593 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:11.243712 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5e35e1bf-770b-4899-a393-80258d5f9593 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:11.244137 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5e35e1bf-770b-4899-a393-80258d5f9593 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:11.433811 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5e35e1bf-770b-4899-a393-80258d5f9593 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:11.442344 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5e35e1bf-770b-4899-a393-80258d5f9593 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1552 microversion: 2.1 time: 0.212961 Oct 14 03:13:11.449769 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 433/847] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:11 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1552 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:11.459625 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9c5645bc-4b53-4f10-892f-048bb5b3b7f2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:11.460127 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9c5645bc-4b53-4f10-892f-048bb5b3b7f2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:11.466083 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9c5645bc-4b53-4f10-892f-048bb5b3b7f2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:11.466569 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9c5645bc-4b53-4f10-892f-048bb5b3b7f2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:11.467011 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9c5645bc-4b53-4f10-892f-048bb5b3b7f2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:11.468375 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9c5645bc-4b53-4f10-892f-048bb5b3b7f2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:11.468892 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9c5645bc-4b53-4f10-892f-048bb5b3b7f2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:11.469325 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9c5645bc-4b53-4f10-892f-048bb5b3b7f2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:11.491558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9c5645bc-4b53-4f10-892f-048bb5b3b7f2 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716/ips" status: 200 len: 152 microversion: 2.20 time: 0.227064 Oct 14 03:13:11.492094 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 415/848] 10.222.0.13 () {60 vars in 1289 bytes} [Fri Oct 14 03:13:11 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716/ips => generated 152 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 03:13:11.702928 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-c46390d1-5525-43ea-a1c6-ddc14e5726fb req-335aff54-436a-4e5a-9085-dbc78d110cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c3606f-b3fb-4249-b5fd-a2de8f5debc2", "name": "network-vif-deleted", "tag": "fcb4f2b3-a43c-4d79-98f7-46d493d8d296"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:11.712589 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-c46390d1-5525-43ea-a1c6-ddc14e5726fb req-335aff54-436a-4e5a-9085-dbc78d110cb9 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:11.713239 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-c46390d1-5525-43ea-a1c6-ddc14e5726fb req-335aff54-436a-4e5a-9085-dbc78d110cb9 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:11.713758 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-c46390d1-5525-43ea-a1c6-ddc14e5726fb req-335aff54-436a-4e5a-9085-dbc78d110cb9 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:11.725388 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-c46390d1-5525-43ea-a1c6-ddc14e5726fb req-335aff54-436a-4e5a-9085-dbc78d110cb9 service nova] Creating event network-vif-deleted:fcb4f2b3-a43c-4d79-98f7-46d493d8d296 for instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 on hv-cinder-80152 Oct 14 03:13:11.730520 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-c46390d1-5525-43ea-a1c6-ddc14e5726fb req-335aff54-436a-4e5a-9085-dbc78d110cb9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098773 Oct 14 03:13:11.731125 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 434/849] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:12.112131 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-867da4a0-e75e-49a9-ad4a-2ec937378f88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:12.112775 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-867da4a0-e75e-49a9-ad4a-2ec937378f88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] [instance: ec35719e-f7e5-4961-b289-277efae29da5] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:12.121306 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-867da4a0-e75e-49a9-ad4a-2ec937378f88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:12.121796 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-867da4a0-e75e-49a9-ad4a-2ec937378f88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:12.122230 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-867da4a0-e75e-49a9-ad4a-2ec937378f88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:12.122927 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-867da4a0-e75e-49a9-ad4a-2ec937378f88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:12.123430 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-867da4a0-e75e-49a9-ad4a-2ec937378f88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:12.124496 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-867da4a0-e75e-49a9-ad4a-2ec937378f88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:12.141195 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-867da4a0-e75e-49a9-ad4a-2ec937378f88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] HTTP exception thrown: Instance ec35719e-f7e5-4961-b289-277efae29da5 could not be found. Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-867da4a0-e75e-49a9-ad4a-2ec937378f88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Request method failure captured: Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 HTTP/1.1 Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNMV1oQqABeGlGrAyJA4MhiofscFZo9vOpZHFY76hOfflyMcIJChGaMl9Zb0_0Rn3jhlFVU1DtypTxVyk7CIj9J7gBAtvkoegQiyqaCMSAE29gCAvGdo1tAD0TRwX7enDJnU7jIv3YHmD430q9ZV0JMmrnpvKRgYVi58HbONe5bv4nc Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: faf6f8c0f3694f42a30232874a142685 Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1089667518 Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:13:12.142972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:13:12.144676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/faf6f8c0f3694f42a30232874a142685"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/faf6f8c0f3694f42a30232874a142685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/faf6f8c0f3694f42a30232874a142685"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_faf6f8c0f3694f42a30232874a142685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:13:12.144676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-VolumesSnapshotTestJSON-1089667518 Oct 14 03:13:12.144676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: faf6f8c0f3694f42a30232874a142685 Oct 14 03:13:12.144676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1089667518 Oct 14 03:13:12.144676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-VolumesSnapshotTestJSON-1089667518-project Oct 14 03:13:12.144676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:13:12.144676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:13:12.144676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 7175a36794194edba6b16366b0e12a0c Oct 14 03:13:12.144676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-VolumesSnapshotTestJSON-1089667518-project Oct 14 03:13:12.144676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:13:12.144676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance ec35719e-f7e5-4961-b289-277efae29da5 could not be found. Oct 14 03:13:12.144676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': 'ec35719e-f7e5-4961-b289-277efae29da5'} Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec35719e-f7e5-4961-b289-277efae29da5 could not be found. Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:12.145585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec35719e-f7e5-4961-b289-277efae29da5 could not be found. Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec35719e-f7e5-4961-b289-277efae29da5 could not be found. Oct 14 03:13:12.146994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:12.149836 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-867da4a0-e75e-49a9-ad4a-2ec937378f88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] Returning 404 to user: Instance ec35719e-f7e5-4961-b289-277efae29da5 could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:12.151371 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-867da4a0-e75e-49a9-ad4a-2ec937378f88 tempest-VolumesSnapshotTestJSON-1089667518 tempest-VolumesSnapshotTestJSON-1089667518-project] 10.222.0.13 "GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5" status: 404 len: 111 microversion: 2.1 time: 0.044243 Oct 14 03:13:12.152231 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 416/850] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:12 2022] GET /compute/v2.1/servers/ec35719e-f7e5-4961-b289-277efae29da5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:12.468335 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3a750abc-43c7-46cf-81ff-6137aebcb897 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:12.469559 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3a750abc-43c7-46cf-81ff-6137aebcb897 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:12.476210 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a750abc-43c7-46cf-81ff-6137aebcb897 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:12.476746 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a750abc-43c7-46cf-81ff-6137aebcb897 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:12.477203 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a750abc-43c7-46cf-81ff-6137aebcb897 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:12.477886 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a750abc-43c7-46cf-81ff-6137aebcb897 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:12.478340 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a750abc-43c7-46cf-81ff-6137aebcb897 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:12.478762 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a750abc-43c7-46cf-81ff-6137aebcb897 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:12.510709 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a750abc-43c7-46cf-81ff-6137aebcb897 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:12.511287 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a750abc-43c7-46cf-81ff-6137aebcb897 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:12.511730 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a750abc-43c7-46cf-81ff-6137aebcb897 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:12.512173 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-3a750abc-43c7-46cf-81ff-6137aebcb897 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lazy-loading 'fault' on Instance uuid 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:12.556890 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3a750abc-43c7-46cf-81ff-6137aebcb897 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79116777e354734b73a0b334fd013c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709ccf636093493093e88488ce49484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:12.564995 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3a750abc-43c7-46cf-81ff-6137aebcb897 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 200 len: 1347 microversion: 2.1 time: 0.102156 Oct 14 03:13:12.565556 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 435/851] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:12 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 1347 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:13.592413 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-dd75addc-1141-4271-8651-f7a5dd387b13 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:13.593729 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-dd75addc-1141-4271-8651-f7a5dd387b13 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] [instance: 93c3606f-b3fb-4249-b5fd-a2de8f5debc2] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:13.600715 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd75addc-1141-4271-8651-f7a5dd387b13 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:13.601202 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd75addc-1141-4271-8651-f7a5dd387b13 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:13.601635 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd75addc-1141-4271-8651-f7a5dd387b13 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:13.603674 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd75addc-1141-4271-8651-f7a5dd387b13 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:13.603674 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd75addc-1141-4271-8651-f7a5dd387b13 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:13.603674 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-dd75addc-1141-4271-8651-f7a5dd387b13 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:13.618458 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-dd75addc-1141-4271-8651-f7a5dd387b13 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] HTTP exception thrown: Instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 could not be found. Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-dd75addc-1141-4271-8651-f7a5dd387b13 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Request method failure captured: Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 HTTP/1.1 Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNL49v_Cf3OuoDpTtyLbZ0J0mcmbb6ZzSiMzmHzDrWK3jeT8tEj9aDqGotGby4nWeNk6lKpqiCwo1XTQz_zSw7gF5bplqC-wbf5cg9tLXb_bzVSjlzU8MeDhDF8mp05apqCrhr8Pv3JE9pMxenoidAqWqsyXKmrgGLt4GcNEBuwKd30 Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 709ccf636093493093e88488ce49484f Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-TestMinimumBasicScenario-116381281 Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:13:13.620108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:13:13.621589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/709ccf636093493093e88488ce49484f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/709ccf636093493093e88488ce49484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/709ccf636093493093e88488ce49484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_709ccf636093493093e88488ce49484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:13:13.621589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-TestMinimumBasicScenario-116381281 Oct 14 03:13:13.621589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 709ccf636093493093e88488ce49484f Oct 14 03:13:13.621589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-TestMinimumBasicScenario-116381281 Oct 14 03:13:13.621589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-TestMinimumBasicScenario-116381281-project Oct 14 03:13:13.621589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:13:13.621589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:13:13.621589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: c79116777e354734b73a0b334fd013c9 Oct 14 03:13:13.621589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-TestMinimumBasicScenario-116381281-project Oct 14 03:13:13.621589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:13:13.621589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 could not be found. Oct 14 03:13:13.621589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': '93c3606f-b3fb-4249-b5fd-a2de8f5debc2'} Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 could not be found. Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:13.622314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 could not be found. Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 could not be found. Oct 14 03:13:13.623497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:13.625188 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-dd75addc-1141-4271-8651-f7a5dd387b13 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Returning 404 to user: Instance 93c3606f-b3fb-4249-b5fd-a2de8f5debc2 could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:13.625188 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-dd75addc-1141-4271-8651-f7a5dd387b13 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2" status: 404 len: 111 microversion: 2.1 time: 0.033305 Oct 14 03:13:13.625188 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 417/852] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:13 2022] GET /compute/v2.1/servers/93c3606f-b3fb-4249-b5fd-a2de8f5debc2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:13.631777 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-501f4b4e-ba62-4bbf-b136-54ba58acaa17 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] Calling method '.version_select at 0x7fdcc74f1af0>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:13.702620 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c123b2b8-af1d-4684-ab96-db906c93258a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:13.703253 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c123b2b8-af1d-4684-ab96-db906c93258a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:13.709838 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c123b2b8-af1d-4684-ab96-db906c93258a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:13.710333 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c123b2b8-af1d-4684-ab96-db906c93258a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:13.710777 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c123b2b8-af1d-4684-ab96-db906c93258a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:13.711489 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c123b2b8-af1d-4684-ab96-db906c93258a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:13.711947 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c123b2b8-af1d-4684-ab96-db906c93258a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:13.712457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c123b2b8-af1d-4684-ab96-db906c93258a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:13.732997 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-501f4b4e-ba62-4bbf-b136-54ba58acaa17 tempest-TestMinimumBasicScenario-116381281 tempest-TestMinimumBasicScenario-116381281-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2002108838" status: 202 len: 0 microversion: 2.1 time: 0.104917 Oct 14 03:13:13.734550 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 436/853] 10.222.0.13 () {58 vars in 1272 bytes} [Fri Oct 14 03:13:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2002108838 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:13:13.747799 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-c123b2b8-af1d-4684-ab96-db906c93258a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lazy-loading 'flavor' on Instance uuid b7c6bac7-dcd5-4fd2-b81d-682898442716 {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:14.415558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c123b2b8-af1d-4684-ab96-db906c93258a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "POST /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716/action" status: 202 len: 0 microversion: 2.20 time: 0.712650 Oct 14 03:13:14.415558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 418/854] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Oct 14 03:13:13 2022] POST /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 14 03:13:14.420332 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-4e632233-884a-45b7-9979-1be412146285 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:14.421268 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-4e632233-884a-45b7-9979-1be412146285 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:14.429270 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4e632233-884a-45b7-9979-1be412146285 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:14.430042 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4e632233-884a-45b7-9979-1be412146285 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:14.430484 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4e632233-884a-45b7-9979-1be412146285 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:14.431413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4e632233-884a-45b7-9979-1be412146285 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:14.432036 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4e632233-884a-45b7-9979-1be412146285 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:14.436954 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4e632233-884a-45b7-9979-1be412146285 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:14.583308 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4e632233-884a-45b7-9979-1be412146285 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:14.587393 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:14.595288 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4e632233-884a-45b7-9979-1be412146285 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:14.598273 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4e632233-884a-45b7-9979-1be412146285 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:14.599835 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-4e632233-884a-45b7-9979-1be412146285 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.183568 Oct 14 03:13:14.600574 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 437/855] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:14 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:15.627966 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-accea32d-7e9f-4b9c-b833-358f3d1015f3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:15.629064 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-accea32d-7e9f-4b9c-b833-358f3d1015f3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:15.636150 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-accea32d-7e9f-4b9c-b833-358f3d1015f3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:15.636840 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-accea32d-7e9f-4b9c-b833-358f3d1015f3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:15.637351 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-accea32d-7e9f-4b9c-b833-358f3d1015f3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:15.638125 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-accea32d-7e9f-4b9c-b833-358f3d1015f3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:15.638647 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-accea32d-7e9f-4b9c-b833-358f3d1015f3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:15.639087 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-accea32d-7e9f-4b9c-b833-358f3d1015f3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:15.819676 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-accea32d-7e9f-4b9c-b833-358f3d1015f3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:15.828800 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-accea32d-7e9f-4b9c-b833-358f3d1015f3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:15.830423 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-accea32d-7e9f-4b9c-b833-358f3d1015f3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:15.831649 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-accea32d-7e9f-4b9c-b833-358f3d1015f3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.208879 Oct 14 03:13:15.832275 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 419/856] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:15 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:16.858908 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3af079ad-e7d2-4153-80c2-5e56792396a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:16.860269 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3af079ad-e7d2-4153-80c2-5e56792396a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:16.867946 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3af079ad-e7d2-4153-80c2-5e56792396a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:16.868740 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3af079ad-e7d2-4153-80c2-5e56792396a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:16.869221 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3af079ad-e7d2-4153-80c2-5e56792396a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:16.869919 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3af079ad-e7d2-4153-80c2-5e56792396a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:16.870799 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3af079ad-e7d2-4153-80c2-5e56792396a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:16.871219 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3af079ad-e7d2-4153-80c2-5e56792396a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:17.029099 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3af079ad-e7d2-4153-80c2-5e56792396a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:17.038263 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3af079ad-e7d2-4153-80c2-5e56792396a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:17.039833 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3af079ad-e7d2-4153-80c2-5e56792396a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:17.041274 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3af079ad-e7d2-4153-80c2-5e56792396a3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.186693 Oct 14 03:13:17.041935 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 438/857] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:16 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:18.069568 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8caee5a9-c80e-42b3-860d-036ede1f8c2e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:18.071233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8caee5a9-c80e-42b3-860d-036ede1f8c2e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:18.078751 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8caee5a9-c80e-42b3-860d-036ede1f8c2e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:18.079377 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8caee5a9-c80e-42b3-860d-036ede1f8c2e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:18.079922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8caee5a9-c80e-42b3-860d-036ede1f8c2e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:18.080764 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8caee5a9-c80e-42b3-860d-036ede1f8c2e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:18.081322 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8caee5a9-c80e-42b3-860d-036ede1f8c2e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:18.081849 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8caee5a9-c80e-42b3-860d-036ede1f8c2e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:18.232906 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8caee5a9-c80e-42b3-860d-036ede1f8c2e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:18.241711 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8caee5a9-c80e-42b3-860d-036ede1f8c2e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:18.243205 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8caee5a9-c80e-42b3-860d-036ede1f8c2e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:18.244368 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8caee5a9-c80e-42b3-860d-036ede1f8c2e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.179165 Oct 14 03:13:18.244963 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 420/858] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:18 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:19.271466 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5ed6be6d-4751-4dcc-8abf-74767499d6e6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:19.272249 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5ed6be6d-4751-4dcc-8abf-74767499d6e6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:19.278973 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ed6be6d-4751-4dcc-8abf-74767499d6e6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:19.279481 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ed6be6d-4751-4dcc-8abf-74767499d6e6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:19.279930 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ed6be6d-4751-4dcc-8abf-74767499d6e6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:19.280667 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ed6be6d-4751-4dcc-8abf-74767499d6e6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:19.281123 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ed6be6d-4751-4dcc-8abf-74767499d6e6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:19.281550 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5ed6be6d-4751-4dcc-8abf-74767499d6e6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:19.438846 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5ed6be6d-4751-4dcc-8abf-74767499d6e6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:19.456738 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5ed6be6d-4751-4dcc-8abf-74767499d6e6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:19.456738 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5ed6be6d-4751-4dcc-8abf-74767499d6e6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:19.456738 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5ed6be6d-4751-4dcc-8abf-74767499d6e6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.182289 Oct 14 03:13:19.457009 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 439/859] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:19 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:20.361453 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-42a7bfb5-dce0-4c10-a986-0b25349554c3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:20.364279 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-42a7bfb5-dce0-4c10-a986-0b25349554c3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:20.368124 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-42a7bfb5-dce0-4c10-a986-0b25349554c3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:20.368581 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-42a7bfb5-dce0-4c10-a986-0b25349554c3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:20.369019 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-42a7bfb5-dce0-4c10-a986-0b25349554c3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:20.369710 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-42a7bfb5-dce0-4c10-a986-0b25349554c3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:20.370164 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-42a7bfb5-dce0-4c10-a986-0b25349554c3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:20.370589 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-42a7bfb5-dce0-4c10-a986-0b25349554c3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:20.394524 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-42a7bfb5-dce0-4c10-a986-0b25349554c3 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/ips" status: 200 len: 146 microversion: 2.1 time: 0.205880 Oct 14 03:13:20.398797 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 421/860] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Oct 14 03:13:20 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/ips => generated 146 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:20.476800 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c49fe9bc-1811-49c9-96bc-b74185129bc6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:20.477521 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c49fe9bc-1811-49c9-96bc-b74185129bc6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:20.485667 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c49fe9bc-1811-49c9-96bc-b74185129bc6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:20.486541 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c49fe9bc-1811-49c9-96bc-b74185129bc6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:20.487212 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c49fe9bc-1811-49c9-96bc-b74185129bc6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:20.488287 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c49fe9bc-1811-49c9-96bc-b74185129bc6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:20.489481 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c49fe9bc-1811-49c9-96bc-b74185129bc6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:20.490196 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c49fe9bc-1811-49c9-96bc-b74185129bc6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:20.771945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c49fe9bc-1811-49c9-96bc-b74185129bc6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:20.784584 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c49fe9bc-1811-49c9-96bc-b74185129bc6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:20.786256 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c49fe9bc-1811-49c9-96bc-b74185129bc6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:20.787527 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c49fe9bc-1811-49c9-96bc-b74185129bc6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.315455 Oct 14 03:13:20.788240 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 440/861] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:20 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:21.812769 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b3611fb7-e066-4574-ad31-ab446bad0ce8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:21.814620 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b3611fb7-e066-4574-ad31-ab446bad0ce8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:21.822683 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3611fb7-e066-4574-ad31-ab446bad0ce8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:21.823394 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3611fb7-e066-4574-ad31-ab446bad0ce8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:21.824248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3611fb7-e066-4574-ad31-ab446bad0ce8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:21.825223 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3611fb7-e066-4574-ad31-ab446bad0ce8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:21.825884 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3611fb7-e066-4574-ad31-ab446bad0ce8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:21.826655 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b3611fb7-e066-4574-ad31-ab446bad0ce8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:21.983684 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b3611fb7-e066-4574-ad31-ab446bad0ce8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:21.993171 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b3611fb7-e066-4574-ad31-ab446bad0ce8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:21.994663 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b3611fb7-e066-4574-ad31-ab446bad0ce8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:21.995831 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b3611fb7-e066-4574-ad31-ab446bad0ce8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.187501 Oct 14 03:13:21.996435 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 422/862] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:21 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:22.324589 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0e14623e-6514-4009-9a54-2e4d10f99294 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6636ca77-4b8a-4bff-b39f-78efc2d8716a"}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:22.329230 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0e14623e-6514-4009-9a54-2e4d10f99294 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:22.339278 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0e14623e-6514-4009-9a54-2e4d10f99294 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:22.340620 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0e14623e-6514-4009-9a54-2e4d10f99294 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:22.341671 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0e14623e-6514-4009-9a54-2e4d10f99294 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:22.342683 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0e14623e-6514-4009-9a54-2e4d10f99294 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:22.343362 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0e14623e-6514-4009-9a54-2e4d10f99294 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:22.344007 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0e14623e-6514-4009-9a54-2e4d10f99294 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:23.022659 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-1d5b41ec-ef6c-47f0-bff5-8caa274b83ba tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:23.029678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-1d5b41ec-ef6c-47f0-bff5-8caa274b83ba tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:23.049808 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1d5b41ec-ef6c-47f0-bff5-8caa274b83ba tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:23.050871 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1d5b41ec-ef6c-47f0-bff5-8caa274b83ba tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:23.052121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1d5b41ec-ef6c-47f0-bff5-8caa274b83ba tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:23.055030 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1d5b41ec-ef6c-47f0-bff5-8caa274b83ba tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:23.070261 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1d5b41ec-ef6c-47f0-bff5-8caa274b83ba tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:23.071787 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1d5b41ec-ef6c-47f0-bff5-8caa274b83ba tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:23.275980 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1d5b41ec-ef6c-47f0-bff5-8caa274b83ba tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:23.284691 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1d5b41ec-ef6c-47f0-bff5-8caa274b83ba tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:23.286791 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1d5b41ec-ef6c-47f0-bff5-8caa274b83ba tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:23.287969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-1d5b41ec-ef6c-47f0-bff5-8caa274b83ba tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.270921 Oct 14 03:13:23.288811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 423/863] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:23 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:23.914312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0e14623e-6514-4009-9a54-2e4d10f99294 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "POST /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.594392 Oct 14 03:13:23.915077 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 441/864] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Oct 14 03:13:22 2022] POST /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments => generated 194 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:13:24.317677 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-060e68b9-cac3-49dd-97f7-f67f212f8592 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:24.318291 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-060e68b9-cac3-49dd-97f7-f67f212f8592 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:24.324995 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-060e68b9-cac3-49dd-97f7-f67f212f8592 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:24.325421 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-060e68b9-cac3-49dd-97f7-f67f212f8592 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:24.325878 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-060e68b9-cac3-49dd-97f7-f67f212f8592 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:24.326785 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-060e68b9-cac3-49dd-97f7-f67f212f8592 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:24.327025 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-060e68b9-cac3-49dd-97f7-f67f212f8592 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:24.327461 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-060e68b9-cac3-49dd-97f7-f67f212f8592 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:24.492718 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-060e68b9-cac3-49dd-97f7-f67f212f8592 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:24.502387 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-060e68b9-cac3-49dd-97f7-f67f212f8592 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:24.508975 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-060e68b9-cac3-49dd-97f7-f67f212f8592 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:24.510581 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-060e68b9-cac3-49dd-97f7-f67f212f8592 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.197381 Oct 14 03:13:24.516882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 424/865] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:24 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:25.537256 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d71f05c4-36cb-46e2-9068-af246752242b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:25.537948 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d71f05c4-36cb-46e2-9068-af246752242b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:25.544029 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d71f05c4-36cb-46e2-9068-af246752242b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:25.544542 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d71f05c4-36cb-46e2-9068-af246752242b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:25.544984 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d71f05c4-36cb-46e2-9068-af246752242b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:25.545673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d71f05c4-36cb-46e2-9068-af246752242b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:25.546124 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d71f05c4-36cb-46e2-9068-af246752242b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:25.546622 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d71f05c4-36cb-46e2-9068-af246752242b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:25.692158 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d71f05c4-36cb-46e2-9068-af246752242b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:25.700204 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d71f05c4-36cb-46e2-9068-af246752242b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:25.701679 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d71f05c4-36cb-46e2-9068-af246752242b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:25.702895 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d71f05c4-36cb-46e2-9068-af246752242b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.170491 Oct 14 03:13:25.703450 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 442/866] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:25 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:26.728102 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6dd8b6a6-1603-450e-a736-7abe6e18d6e4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:26.728752 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6dd8b6a6-1603-450e-a736-7abe6e18d6e4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:26.735151 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6dd8b6a6-1603-450e-a736-7abe6e18d6e4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:26.735645 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6dd8b6a6-1603-450e-a736-7abe6e18d6e4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:26.736091 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6dd8b6a6-1603-450e-a736-7abe6e18d6e4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:26.736845 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6dd8b6a6-1603-450e-a736-7abe6e18d6e4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:26.737932 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6dd8b6a6-1603-450e-a736-7abe6e18d6e4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:26.738366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6dd8b6a6-1603-450e-a736-7abe6e18d6e4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:26.871295 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6dd8b6a6-1603-450e-a736-7abe6e18d6e4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:26.879748 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6dd8b6a6-1603-450e-a736-7abe6e18d6e4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:26.881271 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6dd8b6a6-1603-450e-a736-7abe6e18d6e4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:26.885029 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6dd8b6a6-1603-450e-a736-7abe6e18d6e4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.158662 Oct 14 03:13:26.885029 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 425/867] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:26 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:27.217599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5eefa058-88f1-486a-a381-40a253d06853 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:27.219840 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5eefa058-88f1-486a-a381-40a253d06853 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:27.222870 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:27.227490 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5eefa058-88f1-486a-a381-40a253d06853 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:27.227972 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5eefa058-88f1-486a-a381-40a253d06853 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:27.228425 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5eefa058-88f1-486a-a381-40a253d06853 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:27.229115 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5eefa058-88f1-486a-a381-40a253d06853 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:27.229698 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5eefa058-88f1-486a-a381-40a253d06853 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:27.229991 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-5eefa058-88f1-486a-a381-40a253d06853 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:27.261784 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5eefa058-88f1-486a-a381-40a253d06853 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048092 Oct 14 03:13:27.262337 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 443/868] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:13:27 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:27.273732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3e6dcd81-0e94-4b57-8011-7b43534b8ab1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:27.274367 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-3e6dcd81-0e94-4b57-8011-7b43534b8ab1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:27.280128 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3e6dcd81-0e94-4b57-8011-7b43534b8ab1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:27.280657 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3e6dcd81-0e94-4b57-8011-7b43534b8ab1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:27.281093 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3e6dcd81-0e94-4b57-8011-7b43534b8ab1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:27.281779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3e6dcd81-0e94-4b57-8011-7b43534b8ab1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:27.282236 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3e6dcd81-0e94-4b57-8011-7b43534b8ab1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:27.282662 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3e6dcd81-0e94-4b57-8011-7b43534b8ab1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:27.310990 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-3e6dcd81-0e94-4b57-8011-7b43534b8ab1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments/6636ca77-4b8a-4bff-b39f-78efc2d8716a" status: 200 len: 194 microversion: 2.1 time: 0.041228 Oct 14 03:13:27.311542 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 426/869] 10.222.0.13 () {58 vars in 1413 bytes} [Fri Oct 14 03:13:27 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments/6636ca77-4b8a-4bff-b39f-78efc2d8716a => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:27.909262 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-966797d2-1960-4755-b84e-e7cbf1a541fe tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:27.910113 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-966797d2-1960-4755-b84e-e7cbf1a541fe tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:27.918569 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-966797d2-1960-4755-b84e-e7cbf1a541fe tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:27.919251 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-966797d2-1960-4755-b84e-e7cbf1a541fe tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:27.919709 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-966797d2-1960-4755-b84e-e7cbf1a541fe tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:27.920600 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-966797d2-1960-4755-b84e-e7cbf1a541fe tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:27.921049 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-966797d2-1960-4755-b84e-e7cbf1a541fe tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:27.921537 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-966797d2-1960-4755-b84e-e7cbf1a541fe tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:28.083873 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-966797d2-1960-4755-b84e-e7cbf1a541fe tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:28.092142 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-966797d2-1960-4755-b84e-e7cbf1a541fe tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:28.093638 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-966797d2-1960-4755-b84e-e7cbf1a541fe tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:28.094826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-966797d2-1960-4755-b84e-e7cbf1a541fe tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.190689 Oct 14 03:13:28.095371 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 444/870] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:27 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:29.040704 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-789f0f45-67c3-45ac-8455-56c8b14c9e1e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "841aff12-1643-43b6-ba53-479a896db39f"}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:29.043141 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-789f0f45-67c3-45ac-8455-56c8b14c9e1e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:29.045617 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:29.050273 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-789f0f45-67c3-45ac-8455-56c8b14c9e1e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:29.050770 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-789f0f45-67c3-45ac-8455-56c8b14c9e1e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:29.051219 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-789f0f45-67c3-45ac-8455-56c8b14c9e1e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:29.054009 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-789f0f45-67c3-45ac-8455-56c8b14c9e1e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:29.054495 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-789f0f45-67c3-45ac-8455-56c8b14c9e1e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:29.056088 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-789f0f45-67c3-45ac-8455-56c8b14c9e1e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:29.122002 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-002a743b-38ef-45e2-ab5b-d3e665b4b626 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:29.122612 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-002a743b-38ef-45e2-ab5b-d3e665b4b626 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:29.130521 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-002a743b-38ef-45e2-ab5b-d3e665b4b626 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:29.141169 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-002a743b-38ef-45e2-ab5b-d3e665b4b626 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:29.141169 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-002a743b-38ef-45e2-ab5b-d3e665b4b626 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:29.141169 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-002a743b-38ef-45e2-ab5b-d3e665b4b626 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:29.141169 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-002a743b-38ef-45e2-ab5b-d3e665b4b626 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:29.141756 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-002a743b-38ef-45e2-ab5b-d3e665b4b626 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:29.267065 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-002a743b-38ef-45e2-ab5b-d3e665b4b626 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:29.274616 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:29.275277 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-002a743b-38ef-45e2-ab5b-d3e665b4b626 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:29.276898 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-002a743b-38ef-45e2-ab5b-d3e665b4b626 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:29.278059 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-002a743b-38ef-45e2-ab5b-d3e665b4b626 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.161303 Oct 14 03:13:29.278613 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 445/871] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:29 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:29.774376 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-789f0f45-67c3-45ac-8455-56c8b14c9e1e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "POST /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.737684 Oct 14 03:13:29.774985 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 427/872] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Oct 14 03:13:29 2022] POST /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:13:30.303735 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-71911686-1de8-46ec-98ff-f5b16b9cee64 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:30.304341 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-71911686-1de8-46ec-98ff-f5b16b9cee64 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:30.310693 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-71911686-1de8-46ec-98ff-f5b16b9cee64 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:30.311174 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-71911686-1de8-46ec-98ff-f5b16b9cee64 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:30.311611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-71911686-1de8-46ec-98ff-f5b16b9cee64 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:30.312304 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-71911686-1de8-46ec-98ff-f5b16b9cee64 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:30.312786 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-71911686-1de8-46ec-98ff-f5b16b9cee64 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:30.313211 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-71911686-1de8-46ec-98ff-f5b16b9cee64 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:30.453089 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-71911686-1de8-46ec-98ff-f5b16b9cee64 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:30.460876 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-71911686-1de8-46ec-98ff-f5b16b9cee64 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:30.462323 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-71911686-1de8-46ec-98ff-f5b16b9cee64 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:30.463478 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-71911686-1de8-46ec-98ff-f5b16b9cee64 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1745 microversion: 2.20 time: 0.164165 Oct 14 03:13:30.464025 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 446/873] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:30 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:31.491059 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9d392923-cf95-429e-94f6-4dad5c0894a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:31.491762 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9d392923-cf95-429e-94f6-4dad5c0894a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:31.497892 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9d392923-cf95-429e-94f6-4dad5c0894a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:31.498377 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9d392923-cf95-429e-94f6-4dad5c0894a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:31.498824 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9d392923-cf95-429e-94f6-4dad5c0894a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:31.499642 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9d392923-cf95-429e-94f6-4dad5c0894a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:31.500102 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9d392923-cf95-429e-94f6-4dad5c0894a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:31.500568 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9d392923-cf95-429e-94f6-4dad5c0894a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:31.626911 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9d392923-cf95-429e-94f6-4dad5c0894a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:31.635370 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9d392923-cf95-429e-94f6-4dad5c0894a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:31.637157 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9d392923-cf95-429e-94f6-4dad5c0894a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:31.638572 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9d392923-cf95-429e-94f6-4dad5c0894a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1745 microversion: 2.20 time: 0.152357 Oct 14 03:13:31.639380 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 428/874] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:31 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:32.201539 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fb2b2fd4-222e-4eec-b622-9b9ab7c82530 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:32.203675 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fb2b2fd4-222e-4eec-b622-9b9ab7c82530 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:32.210139 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fb2b2fd4-222e-4eec-b622-9b9ab7c82530 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:32.211333 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fb2b2fd4-222e-4eec-b622-9b9ab7c82530 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:32.211333 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fb2b2fd4-222e-4eec-b622-9b9ab7c82530 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:32.211768 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fb2b2fd4-222e-4eec-b622-9b9ab7c82530 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:32.212222 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fb2b2fd4-222e-4eec-b622-9b9ab7c82530 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:32.212678 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fb2b2fd4-222e-4eec-b622-9b9ab7c82530 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:32.241588 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fb2b2fd4-222e-4eec-b622-9b9ab7c82530 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043854 Oct 14 03:13:32.242144 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 447/875] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:13:32 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:32.386410 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-adf556a2-d3f3-4131-9f3d-7312d477c5a9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:32.387246 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-adf556a2-d3f3-4131-9f3d-7312d477c5a9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:32.395592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-adf556a2-d3f3-4131-9f3d-7312d477c5a9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:32.396127 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-adf556a2-d3f3-4131-9f3d-7312d477c5a9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:32.396642 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-adf556a2-d3f3-4131-9f3d-7312d477c5a9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:32.397360 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-adf556a2-d3f3-4131-9f3d-7312d477c5a9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:32.397852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-adf556a2-d3f3-4131-9f3d-7312d477c5a9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:32.398289 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-adf556a2-d3f3-4131-9f3d-7312d477c5a9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:32.432119 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-adf556a2-d3f3-4131-9f3d-7312d477c5a9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments/6636ca77-4b8a-4bff-b39f-78efc2d8716a" status: 200 len: 194 microversion: 2.1 time: 0.050806 Oct 14 03:13:32.432830 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 429/876] 10.222.0.13 () {58 vars in 1413 bytes} [Fri Oct 14 03:13:32 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments/6636ca77-4b8a-4bff-b39f-78efc2d8716a => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:32.443122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0caae146-8e11-4291-81b2-2fb62b113b9d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:32.443694 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0caae146-8e11-4291-81b2-2fb62b113b9d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:32.450832 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0caae146-8e11-4291-81b2-2fb62b113b9d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:32.451397 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0caae146-8e11-4291-81b2-2fb62b113b9d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:32.451911 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0caae146-8e11-4291-81b2-2fb62b113b9d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:32.452717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0caae146-8e11-4291-81b2-2fb62b113b9d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:32.453259 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0caae146-8e11-4291-81b2-2fb62b113b9d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:32.453755 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0caae146-8e11-4291-81b2-2fb62b113b9d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:32.539349 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-0caae146-8e11-4291-81b2-2fb62b113b9d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lazy-loading 'services' on Instance uuid 1ce9443a-d60b-446c-84b0-3620d5233c37 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:32.666533 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-24539f31-c367-4838-885e-2de32c552c8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:32.677758 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-24539f31-c367-4838-885e-2de32c552c8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:32.684259 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24539f31-c367-4838-885e-2de32c552c8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:32.685023 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24539f31-c367-4838-885e-2de32c552c8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:32.685588 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24539f31-c367-4838-885e-2de32c552c8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:32.687007 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24539f31-c367-4838-885e-2de32c552c8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:32.688618 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24539f31-c367-4838-885e-2de32c552c8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:32.689159 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-24539f31-c367-4838-885e-2de32c552c8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:32.748116 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0caae146-8e11-4291-81b2-2fb62b113b9d tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments/6636ca77-4b8a-4bff-b39f-78efc2d8716a" status: 202 len: 0 microversion: 2.1 time: 0.308811 Oct 14 03:13:32.748749 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 448/877] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Oct 14 03:13:32 2022] DELETE /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments/6636ca77-4b8a-4bff-b39f-78efc2d8716a => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:13:32.866529 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-24539f31-c367-4838-885e-2de32c552c8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:32.875379 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-24539f31-c367-4838-885e-2de32c552c8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:32.882993 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-24539f31-c367-4838-885e-2de32c552c8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:32.882993 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-24539f31-c367-4838-885e-2de32c552c8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1740 microversion: 2.20 time: 0.217500 Oct 14 03:13:32.898169 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 430/878] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:32 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:33.914902 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3856790b-9dc8-4e02-918f-002c37589ee8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:33.915668 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3856790b-9dc8-4e02-918f-002c37589ee8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:33.930065 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3856790b-9dc8-4e02-918f-002c37589ee8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:33.930298 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3856790b-9dc8-4e02-918f-002c37589ee8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:33.930752 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3856790b-9dc8-4e02-918f-002c37589ee8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:33.935279 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3856790b-9dc8-4e02-918f-002c37589ee8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:33.935279 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3856790b-9dc8-4e02-918f-002c37589ee8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:33.935279 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3856790b-9dc8-4e02-918f-002c37589ee8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:34.133816 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3856790b-9dc8-4e02-918f-002c37589ee8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:34.144258 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3856790b-9dc8-4e02-918f-002c37589ee8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:34.146811 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3856790b-9dc8-4e02-918f-002c37589ee8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:34.148027 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3856790b-9dc8-4e02-918f-002c37589ee8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1740 microversion: 2.20 time: 0.238001 Oct 14 03:13:34.148968 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 449/879] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:33 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:35.009219 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-96481b1c-197b-4067-91a8-159e0a4eeaa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:35.013698 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-96481b1c-197b-4067-91a8-159e0a4eeaa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:35.027425 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-96481b1c-197b-4067-91a8-159e0a4eeaa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:35.029569 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-96481b1c-197b-4067-91a8-159e0a4eeaa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:35.030267 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-96481b1c-197b-4067-91a8-159e0a4eeaa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:35.031196 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-96481b1c-197b-4067-91a8-159e0a4eeaa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:35.031812 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-96481b1c-197b-4067-91a8-159e0a4eeaa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:35.032471 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-96481b1c-197b-4067-91a8-159e0a4eeaa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:35.069805 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-96481b1c-197b-4067-91a8-159e0a4eeaa5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments/841aff12-1643-43b6-ba53-479a896db39f" status: 200 len: 194 microversion: 2.1 time: 0.065357 Oct 14 03:13:35.071034 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 450/880] 10.222.0.13 () {58 vars in 1413 bytes} [Fri Oct 14 03:13:35 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments/841aff12-1643-43b6-ba53-479a896db39f => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:13:35.083963 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-6c046de3-05c8-41b0-8fba-338ad350d067 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:35.084838 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-6c046de3-05c8-41b0-8fba-338ad350d067 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:35.091130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6c046de3-05c8-41b0-8fba-338ad350d067 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:35.091836 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6c046de3-05c8-41b0-8fba-338ad350d067 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:35.092660 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6c046de3-05c8-41b0-8fba-338ad350d067 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:35.093581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6c046de3-05c8-41b0-8fba-338ad350d067 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:35.094199 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6c046de3-05c8-41b0-8fba-338ad350d067 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:35.094901 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6c046de3-05c8-41b0-8fba-338ad350d067 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:35.105895 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-9892c66d-f58e-4872-8407-b6c3bec85ac1 req-2afa60dd-5565-4693-813c-e40c2179d139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c6bac7-dcd5-4fd2-b81d-682898442716", "name": "network-vif-plugged", "status": "completed", "tag": "a0776357-4e9e-4296-84d0-654e4b00c042"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:35.127594 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-9892c66d-f58e-4872-8407-b6c3bec85ac1 req-2afa60dd-5565-4693-813c-e40c2179d139 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:35.128078 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-9892c66d-f58e-4872-8407-b6c3bec85ac1 req-2afa60dd-5565-4693-813c-e40c2179d139 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:35.128747 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-9892c66d-f58e-4872-8407-b6c3bec85ac1 req-2afa60dd-5565-4693-813c-e40c2179d139 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:35.163625 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-9892c66d-f58e-4872-8407-b6c3bec85ac1 req-2afa60dd-5565-4693-813c-e40c2179d139 service nova] Creating event network-vif-plugged:a0776357-4e9e-4296-84d0-654e4b00c042 for instance b7c6bac7-dcd5-4fd2-b81d-682898442716 on hv-cinder-80152 Oct 14 03:13:35.170585 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-9892c66d-f58e-4872-8407-b6c3bec85ac1 req-2afa60dd-5565-4693-813c-e40c2179d139 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.374509 Oct 14 03:13:35.171895 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 431/881] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:35.180624 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3a8be742-6f75-4e5c-acf9-e7d07ee09c65 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:35.181722 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-3a8be742-6f75-4e5c-acf9-e7d07ee09c65 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:35.194560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3a8be742-6f75-4e5c-acf9-e7d07ee09c65 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:35.194560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3a8be742-6f75-4e5c-acf9-e7d07ee09c65 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:35.194560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3a8be742-6f75-4e5c-acf9-e7d07ee09c65 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:35.194560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3a8be742-6f75-4e5c-acf9-e7d07ee09c65 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:35.195230 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3a8be742-6f75-4e5c-acf9-e7d07ee09c65 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:35.195901 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3a8be742-6f75-4e5c-acf9-e7d07ee09c65 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:35.435992 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3a8be742-6f75-4e5c-acf9-e7d07ee09c65 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:35.448562 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3a8be742-6f75-4e5c-acf9-e7d07ee09c65 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:35.450080 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3a8be742-6f75-4e5c-acf9-e7d07ee09c65 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:35.451342 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-3a8be742-6f75-4e5c-acf9-e7d07ee09c65 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1740 microversion: 2.20 time: 0.276926 Oct 14 03:13:35.451957 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 432/882] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:35 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:35.476966 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-6c046de3-05c8-41b0-8fba-338ad350d067 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lazy-loading 'services' on Instance uuid 1ce9443a-d60b-446c-84b0-3620d5233c37 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:35.644723 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:35.732903 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-6c046de3-05c8-41b0-8fba-338ad350d067 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments/841aff12-1643-43b6-ba53-479a896db39f" status: 202 len: 0 microversion: 2.1 time: 0.652512 Oct 14 03:13:35.733519 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 451/883] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Oct 14 03:13:35 2022] DELETE /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments/841aff12-1643-43b6-ba53-479a896db39f => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:13:36.479610 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-fc2a276b-fa39-417f-874f-b4fc9f0e7a98 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:36.480523 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-fc2a276b-fa39-417f-874f-b4fc9f0e7a98 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:36.486892 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc2a276b-fa39-417f-874f-b4fc9f0e7a98 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:36.487344 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc2a276b-fa39-417f-874f-b4fc9f0e7a98 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:36.487789 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc2a276b-fa39-417f-874f-b4fc9f0e7a98 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:36.488518 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc2a276b-fa39-417f-874f-b4fc9f0e7a98 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:36.488978 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc2a276b-fa39-417f-874f-b4fc9f0e7a98 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:36.489408 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fc2a276b-fa39-417f-874f-b4fc9f0e7a98 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:36.621893 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-fc2a276b-fa39-417f-874f-b4fc9f0e7a98 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:36.631584 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-fc2a276b-fa39-417f-874f-b4fc9f0e7a98 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:36.633204 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-fc2a276b-fa39-417f-874f-b4fc9f0e7a98 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:36.634496 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-fc2a276b-fa39-417f-874f-b4fc9f0e7a98 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1740 microversion: 2.20 time: 0.159363 Oct 14 03:13:36.643113 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 433/884] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:36 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:36.991871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-59475b67-c5bc-4a26-b177-de10db7d4735 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:36.996353 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-59475b67-c5bc-4a26-b177-de10db7d4735 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:37.007362 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59475b67-c5bc-4a26-b177-de10db7d4735 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:37.009410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59475b67-c5bc-4a26-b177-de10db7d4735 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:37.009410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59475b67-c5bc-4a26-b177-de10db7d4735 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:37.010654 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59475b67-c5bc-4a26-b177-de10db7d4735 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:37.011432 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59475b67-c5bc-4a26-b177-de10db7d4735 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:37.012500 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-59475b67-c5bc-4a26-b177-de10db7d4735 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:37.047311 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-59475b67-c5bc-4a26-b177-de10db7d4735 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063113 Oct 14 03:13:37.048182 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 452/885] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:13:36 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:13:37.188146 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-037d084d-8c28-4fcf-a3af-d577598739aa tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:37.191367 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-037d084d-8c28-4fcf-a3af-d577598739aa tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:37.199238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-037d084d-8c28-4fcf-a3af-d577598739aa tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:37.200075 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-037d084d-8c28-4fcf-a3af-d577598739aa tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:37.200874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-037d084d-8c28-4fcf-a3af-d577598739aa tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:37.201860 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-037d084d-8c28-4fcf-a3af-d577598739aa tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:37.202531 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-037d084d-8c28-4fcf-a3af-d577598739aa tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:37.203271 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-037d084d-8c28-4fcf-a3af-d577598739aa tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:37.243895 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-037d084d-8c28-4fcf-a3af-d577598739aa tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060692 Oct 14 03:13:37.251340 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 434/886] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:13:37 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:13:37.323407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3690f0cd-f2ee-4611-a35f-136af3ec7683 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:37.324132 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3690f0cd-f2ee-4611-a35f-136af3ec7683 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:37.332701 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3690f0cd-f2ee-4611-a35f-136af3ec7683 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:37.333427 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3690f0cd-f2ee-4611-a35f-136af3ec7683 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:37.334052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3690f0cd-f2ee-4611-a35f-136af3ec7683 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:37.334922 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3690f0cd-f2ee-4611-a35f-136af3ec7683 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:37.335559 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3690f0cd-f2ee-4611-a35f-136af3ec7683 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:37.336233 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3690f0cd-f2ee-4611-a35f-136af3ec7683 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:37.374604 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3690f0cd-f2ee-4611-a35f-136af3ec7683 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Going to try to terminate instance {{(pid=119301) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:13:37.663598 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2f4224b9-b361-4b1a-b153-344ab41868b5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:37.666316 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2f4224b9-b361-4b1a-b153-344ab41868b5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:37.684448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f4224b9-b361-4b1a-b153-344ab41868b5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:37.686131 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f4224b9-b361-4b1a-b153-344ab41868b5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:37.686131 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f4224b9-b361-4b1a-b153-344ab41868b5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:37.686766 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f4224b9-b361-4b1a-b153-344ab41868b5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:37.687394 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f4224b9-b361-4b1a-b153-344ab41868b5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:37.688036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f4224b9-b361-4b1a-b153-344ab41868b5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:37.740057 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3690f0cd-f2ee-4611-a35f-136af3ec7683 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 204 len: 0 microversion: 2.1 time: 0.421386 Oct 14 03:13:37.742056 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 453/887] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:13:37 2022] DELETE /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:13:37.751752 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b368e0b2-2088-4d83-a8ea-3a9066fb79da tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:37.751752 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b368e0b2-2088-4d83-a8ea-3a9066fb79da tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:37.767781 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b368e0b2-2088-4d83-a8ea-3a9066fb79da tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:37.768280 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b368e0b2-2088-4d83-a8ea-3a9066fb79da tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:37.768751 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b368e0b2-2088-4d83-a8ea-3a9066fb79da tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:37.769468 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b368e0b2-2088-4d83-a8ea-3a9066fb79da tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:37.769914 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b368e0b2-2088-4d83-a8ea-3a9066fb79da tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:37.770657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b368e0b2-2088-4d83-a8ea-3a9066fb79da tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:37.905467 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2f4224b9-b361-4b1a-b153-344ab41868b5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:37.916932 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2f4224b9-b361-4b1a-b153-344ab41868b5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:37.916932 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2f4224b9-b361-4b1a-b153-344ab41868b5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:37.924522 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2f4224b9-b361-4b1a-b153-344ab41868b5 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1740 microversion: 2.20 time: 0.266418 Oct 14 03:13:37.943842 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 435/888] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:37 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1740 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:37.977694 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b368e0b2-2088-4d83-a8ea-3a9066fb79da tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:37.989820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b368e0b2-2088-4d83-a8ea-3a9066fb79da tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1672 microversion: 2.1 time: 0.242421 Oct 14 03:13:38.004842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 454/889] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:37 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1672 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:38.952044 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-aa42561c-bda2-4a5e-8288-b7edfd0f6593 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:38.954086 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-aa42561c-bda2-4a5e-8288-b7edfd0f6593 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:38.962344 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-aa42561c-bda2-4a5e-8288-b7edfd0f6593 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:38.963097 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-aa42561c-bda2-4a5e-8288-b7edfd0f6593 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:38.964431 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-aa42561c-bda2-4a5e-8288-b7edfd0f6593 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:38.965375 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-aa42561c-bda2-4a5e-8288-b7edfd0f6593 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:38.966183 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-aa42561c-bda2-4a5e-8288-b7edfd0f6593 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:38.967809 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-aa42561c-bda2-4a5e-8288-b7edfd0f6593 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:39.016688 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-bc60a123-5399-4768-8117-860e9b371cc1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:39.018556 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-bc60a123-5399-4768-8117-860e9b371cc1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:39.025980 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bc60a123-5399-4768-8117-860e9b371cc1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:39.026859 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bc60a123-5399-4768-8117-860e9b371cc1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:39.027488 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bc60a123-5399-4768-8117-860e9b371cc1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:39.029194 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bc60a123-5399-4768-8117-860e9b371cc1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:39.029844 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bc60a123-5399-4768-8117-860e9b371cc1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:39.030455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bc60a123-5399-4768-8117-860e9b371cc1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:39.192611 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-aa42561c-bda2-4a5e-8288-b7edfd0f6593 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:39.217424 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-aa42561c-bda2-4a5e-8288-b7edfd0f6593 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:39.226880 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-aa42561c-bda2-4a5e-8288-b7edfd0f6593 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:39.229641 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-aa42561c-bda2-4a5e-8288-b7edfd0f6593 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1740 microversion: 2.20 time: 0.282997 Oct 14 03:13:39.232257 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 436/890] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:38 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1740 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:39.348025 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-bc60a123-5399-4768-8117-860e9b371cc1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:39.357564 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-bc60a123-5399-4768-8117-860e9b371cc1 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1672 microversion: 2.1 time: 0.345060 Oct 14 03:13:39.369354 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 455/891] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:39 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1672 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:40.259989 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-788bd422-0db7-41f0-bedd-e7d018a1e262 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:40.261167 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-788bd422-0db7-41f0-bedd-e7d018a1e262 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:40.267882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-788bd422-0db7-41f0-bedd-e7d018a1e262 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:40.268527 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-788bd422-0db7-41f0-bedd-e7d018a1e262 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:40.268974 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-788bd422-0db7-41f0-bedd-e7d018a1e262 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:40.269687 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-788bd422-0db7-41f0-bedd-e7d018a1e262 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:40.270290 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-788bd422-0db7-41f0-bedd-e7d018a1e262 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:40.270726 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-788bd422-0db7-41f0-bedd-e7d018a1e262 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:40.384559 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8b3ff2e6-b185-4374-be61-d9ae2109cd3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:40.386692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8b3ff2e6-b185-4374-be61-d9ae2109cd3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:40.396508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b3ff2e6-b185-4374-be61-d9ae2109cd3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:40.397354 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b3ff2e6-b185-4374-be61-d9ae2109cd3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:40.398221 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b3ff2e6-b185-4374-be61-d9ae2109cd3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:40.399221 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b3ff2e6-b185-4374-be61-d9ae2109cd3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:40.399841 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b3ff2e6-b185-4374-be61-d9ae2109cd3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:40.400446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8b3ff2e6-b185-4374-be61-d9ae2109cd3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:40.412360 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-788bd422-0db7-41f0-bedd-e7d018a1e262 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:40.425573 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-788bd422-0db7-41f0-bedd-e7d018a1e262 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:40.427329 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-788bd422-0db7-41f0-bedd-e7d018a1e262 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:40.428775 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-788bd422-0db7-41f0-bedd-e7d018a1e262 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1740 microversion: 2.20 time: 0.173039 Oct 14 03:13:40.429773 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 437/892] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:40 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:40.634289 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8b3ff2e6-b185-4374-be61-d9ae2109cd3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:40.644569 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8b3ff2e6-b185-4374-be61-d9ae2109cd3f tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1672 microversion: 2.1 time: 0.265064 Oct 14 03:13:40.654211 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 456/893] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:40 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1672 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:41.463231 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-4c104d45-d718-4d26-bbdc-144b83376d7c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:41.463880 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-4c104d45-d718-4d26-bbdc-144b83376d7c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:41.474512 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4c104d45-d718-4d26-bbdc-144b83376d7c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:41.476049 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4c104d45-d718-4d26-bbdc-144b83376d7c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:41.478126 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4c104d45-d718-4d26-bbdc-144b83376d7c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:41.478126 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4c104d45-d718-4d26-bbdc-144b83376d7c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:41.478126 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4c104d45-d718-4d26-bbdc-144b83376d7c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:41.479697 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4c104d45-d718-4d26-bbdc-144b83376d7c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:41.636593 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4c104d45-d718-4d26-bbdc-144b83376d7c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:41.645881 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4c104d45-d718-4d26-bbdc-144b83376d7c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:41.648185 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4c104d45-d718-4d26-bbdc-144b83376d7c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:41.649731 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-4c104d45-d718-4d26-bbdc-144b83376d7c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1740 microversion: 2.20 time: 0.197837 Oct 14 03:13:41.650549 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 438/894] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:41 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:41.679707 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b663f69b-528c-429a-a522-1635fabc45b9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:41.680949 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b663f69b-528c-429a-a522-1635fabc45b9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:41.691237 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b663f69b-528c-429a-a522-1635fabc45b9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:41.692302 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b663f69b-528c-429a-a522-1635fabc45b9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:41.693428 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b663f69b-528c-429a-a522-1635fabc45b9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:41.695102 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b663f69b-528c-429a-a522-1635fabc45b9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:41.695989 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b663f69b-528c-429a-a522-1635fabc45b9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:41.696667 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b663f69b-528c-429a-a522-1635fabc45b9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:41.822587 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b663f69b-528c-429a-a522-1635fabc45b9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:41.842732 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b663f69b-528c-429a-a522-1635fabc45b9 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1605 microversion: 2.1 time: 0.176380 Oct 14 03:13:41.844426 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 457/895] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:41 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1605 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:41.910026 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-b23fccfc-9f22-4a92-9a5c-6b8b9449d678 req-3ec75e7e-cb06-4fb0-8a22-41c4f8b734fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce9443a-d60b-446c-84b0-3620d5233c37", "name": "network-vif-deleted", "tag": "6e93d958-2f8f-469a-b768-aa7ead1d26b0"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:41.929841 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-b23fccfc-9f22-4a92-9a5c-6b8b9449d678 req-3ec75e7e-cb06-4fb0-8a22-41c4f8b734fb service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:41.930572 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-b23fccfc-9f22-4a92-9a5c-6b8b9449d678 req-3ec75e7e-cb06-4fb0-8a22-41c4f8b734fb service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:41.931168 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-b23fccfc-9f22-4a92-9a5c-6b8b9449d678 req-3ec75e7e-cb06-4fb0-8a22-41c4f8b734fb service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:41.951835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-b23fccfc-9f22-4a92-9a5c-6b8b9449d678 req-3ec75e7e-cb06-4fb0-8a22-41c4f8b734fb service nova] Creating event network-vif-deleted:6e93d958-2f8f-469a-b768-aa7ead1d26b0 for instance 1ce9443a-d60b-446c-84b0-3620d5233c37 on hv-cinder-80152 Oct 14 03:13:41.961602 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-b23fccfc-9f22-4a92-9a5c-6b8b9449d678 req-3ec75e7e-cb06-4fb0-8a22-41c4f8b734fb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055523 Oct 14 03:13:41.962879 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 439/896] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:42.685735 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-2c4d507a-6441-4e67-96d9-e9cfa0bd924d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:42.687025 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-2c4d507a-6441-4e67-96d9-e9cfa0bd924d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:42.705213 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2c4d507a-6441-4e67-96d9-e9cfa0bd924d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:42.706038 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2c4d507a-6441-4e67-96d9-e9cfa0bd924d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:42.706612 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2c4d507a-6441-4e67-96d9-e9cfa0bd924d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:42.707553 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2c4d507a-6441-4e67-96d9-e9cfa0bd924d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:42.708133 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2c4d507a-6441-4e67-96d9-e9cfa0bd924d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:42.708684 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2c4d507a-6441-4e67-96d9-e9cfa0bd924d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:42.874247 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d59c0f2f-b0ea-4e13-8841-e520a3e54807 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:42.875705 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d59c0f2f-b0ea-4e13-8841-e520a3e54807 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:42.885854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d59c0f2f-b0ea-4e13-8841-e520a3e54807 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:42.887358 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d59c0f2f-b0ea-4e13-8841-e520a3e54807 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:42.888039 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d59c0f2f-b0ea-4e13-8841-e520a3e54807 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:42.889217 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d59c0f2f-b0ea-4e13-8841-e520a3e54807 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:42.889951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d59c0f2f-b0ea-4e13-8841-e520a3e54807 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:42.890603 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d59c0f2f-b0ea-4e13-8841-e520a3e54807 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:42.915821 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-2c4d507a-6441-4e67-96d9-e9cfa0bd924d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:42.930101 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-2c4d507a-6441-4e67-96d9-e9cfa0bd924d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:42.947156 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-2c4d507a-6441-4e67-96d9-e9cfa0bd924d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:42.949354 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-2c4d507a-6441-4e67-96d9-e9cfa0bd924d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1740 microversion: 2.20 time: 0.272208 Oct 14 03:13:42.950511 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 458/897] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:42 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:43.030629 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d59c0f2f-b0ea-4e13-8841-e520a3e54807 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:43.033153 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d59c0f2f-b0ea-4e13-8841-e520a3e54807 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:43.033610 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d59c0f2f-b0ea-4e13-8841-e520a3e54807 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:43.034140 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-d59c0f2f-b0ea-4e13-8841-e520a3e54807 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lazy-loading 'fault' on Instance uuid 1ce9443a-d60b-446c-84b0-3620d5233c37 {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:43.119945 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-d59c0f2f-b0ea-4e13-8841-e520a3e54807 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c196d842c4540b5800b4efa0ec4fc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab840c288db6497bbd3a4b221cddf009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:43.135462 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d59c0f2f-b0ea-4e13-8841-e520a3e54807 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 200 len: 1326 microversion: 2.1 time: 0.270086 Oct 14 03:13:43.140763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 440/898] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:42 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 1326 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:43.984172 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-869e4abe-7804-4e06-a869-a09c0d65f75d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:43.984172 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-869e4abe-7804-4e06-a869-a09c0d65f75d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:43.995359 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-869e4abe-7804-4e06-a869-a09c0d65f75d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:43.999223 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-869e4abe-7804-4e06-a869-a09c0d65f75d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:44.000025 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-869e4abe-7804-4e06-a869-a09c0d65f75d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:44.000977 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-869e4abe-7804-4e06-a869-a09c0d65f75d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:44.001611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-869e4abe-7804-4e06-a869-a09c0d65f75d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:44.005786 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-869e4abe-7804-4e06-a869-a09c0d65f75d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:44.167471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0321e45e-8b9d-48a7-81f4-d0fd75288590 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:44.168267 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-0321e45e-8b9d-48a7-81f4-d0fd75288590 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:44.177030 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0321e45e-8b9d-48a7-81f4-d0fd75288590 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:44.177574 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0321e45e-8b9d-48a7-81f4-d0fd75288590 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:44.178085 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0321e45e-8b9d-48a7-81f4-d0fd75288590 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:44.178874 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0321e45e-8b9d-48a7-81f4-d0fd75288590 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:44.180241 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0321e45e-8b9d-48a7-81f4-d0fd75288590 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:44.182811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0321e45e-8b9d-48a7-81f4-d0fd75288590 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:44.209316 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-0321e45e-8b9d-48a7-81f4-d0fd75288590 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] HTTP exception thrown: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0321e45e-8b9d-48a7-81f4-d0fd75288590 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Request method failure captured: Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 HTTP/1.1 Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKAP7HgYtc4-4-k7Pvw-tZEzRcER0oItatmvKceu0BM_7NqmPQSF9ui1_MKz4TXUi5Z_JuvPOc5RAU-6izpdrTjOyvsO3qVrKLzI_aKsakPLD0cbn0JT5PYSdN6NHyN4a_sJAcK6d8UQV7ALtSTJXAWkW3m-4b8hIBQotWtutxEyqM Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: ab840c288db6497bbd3a4b221cddf009 Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:13:44.220013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:13:44.221608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:13:44.221608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:44.221608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: ab840c288db6497bbd3a4b221cddf009 Oct 14 03:13:44.221608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:44.221608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-AttachVolumeTestJSON-2137333315-project Oct 14 03:13:44.221608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:13:44.221608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:13:44.221608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 2c196d842c4540b5800b4efa0ec4fc73 Oct 14 03:13:44.221608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-AttachVolumeTestJSON-2137333315-project Oct 14 03:13:44.221608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:13:44.221608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:44.221608 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': '1ce9443a-d60b-446c-84b0-3620d5233c37'} Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:44.222544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:44.224181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:44.225962 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0321e45e-8b9d-48a7-81f4-d0fd75288590 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Returning 404 to user: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:44.225962 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-0321e45e-8b9d-48a7-81f4-d0fd75288590 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 404 len: 111 microversion: 2.1 time: 0.058182 Oct 14 03:13:44.225962 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 441/899] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:44 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:13:44.248439 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-83b69a02-9a7f-4e49-a99d-d5041496c043 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '.version_select at 0x7fdcc743aaf0>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:44.369234 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-83b69a02-9a7f-4e49-a99d-d5041496c043 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-230829737" status: 202 len: 0 microversion: 2.1 time: 0.135541 Oct 14 03:13:44.369965 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 442/900] 10.222.0.13 () {58 vars in 1218 bytes} [Fri Oct 14 03:13:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-230829737 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:13:44.540248 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-869e4abe-7804-4e06-a869-a09c0d65f75d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:44.558675 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-869e4abe-7804-4e06-a869-a09c0d65f75d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:44.561470 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-869e4abe-7804-4e06-a869-a09c0d65f75d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:44.562936 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-869e4abe-7804-4e06-a869-a09c0d65f75d tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1740 microversion: 2.20 time: 0.586545 Oct 14 03:13:44.566824 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 459/901] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:43 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1740 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:45.598886 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2f5e9e52-2246-4bce-80c8-5d660a81e093 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:45.600237 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2f5e9e52-2246-4bce-80c8-5d660a81e093 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:45.609690 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f5e9e52-2246-4bce-80c8-5d660a81e093 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:45.610604 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f5e9e52-2246-4bce-80c8-5d660a81e093 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:45.612747 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f5e9e52-2246-4bce-80c8-5d660a81e093 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:45.616941 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f5e9e52-2246-4bce-80c8-5d660a81e093 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:45.617750 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f5e9e52-2246-4bce-80c8-5d660a81e093 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:45.618528 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2f5e9e52-2246-4bce-80c8-5d660a81e093 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:45.940822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2f5e9e52-2246-4bce-80c8-5d660a81e093 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:45.969172 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2f5e9e52-2246-4bce-80c8-5d660a81e093 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:45.971093 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2f5e9e52-2246-4bce-80c8-5d660a81e093 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:45.972719 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2f5e9e52-2246-4bce-80c8-5d660a81e093 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1740 microversion: 2.20 time: 0.381425 Oct 14 03:13:45.973432 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 443/902] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:45 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1740 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:46.962138 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8e71cbba-2ecd-4dd1-84a5-7f78cb89cc15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:46.964363 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8e71cbba-2ecd-4dd1-84a5-7f78cb89cc15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:46.972628 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8e71cbba-2ecd-4dd1-84a5-7f78cb89cc15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:46.973800 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8e71cbba-2ecd-4dd1-84a5-7f78cb89cc15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:46.974347 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8e71cbba-2ecd-4dd1-84a5-7f78cb89cc15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:46.975131 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8e71cbba-2ecd-4dd1-84a5-7f78cb89cc15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:46.975589 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8e71cbba-2ecd-4dd1-84a5-7f78cb89cc15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:46.976280 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8e71cbba-2ecd-4dd1-84a5-7f78cb89cc15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:47.014609 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8d6d3865-14cc-444e-a733-1443baec28d6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:47.015799 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8d6d3865-14cc-444e-a733-1443baec28d6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:47.029201 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8d6d3865-14cc-444e-a733-1443baec28d6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:47.029702 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8d6d3865-14cc-444e-a733-1443baec28d6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:47.030144 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8d6d3865-14cc-444e-a733-1443baec28d6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:47.031940 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8d6d3865-14cc-444e-a733-1443baec28d6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:47.037815 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8d6d3865-14cc-444e-a733-1443baec28d6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:47.037815 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8d6d3865-14cc-444e-a733-1443baec28d6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:47.056554 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8e71cbba-2ecd-4dd1-84a5-7f78cb89cc15 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d/ips" status: 200 len: 150 microversion: 2.1 time: 0.101962 Oct 14 03:13:47.057160 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 460/903] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Oct 14 03:13:46 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d/ips => generated 150 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:47.245320 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8d6d3865-14cc-444e-a733-1443baec28d6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:47.260695 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8d6d3865-14cc-444e-a733-1443baec28d6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:47.263815 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8d6d3865-14cc-444e-a733-1443baec28d6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:47.267591 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8d6d3865-14cc-444e-a733-1443baec28d6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1740 microversion: 2.20 time: 0.268422 Oct 14 03:13:47.268463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 444/904] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:46 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:48.300409 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-23094686-e0ed-4180-a5d0-936a3ed73f8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:48.300409 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-23094686-e0ed-4180-a5d0-936a3ed73f8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:48.306158 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-23094686-e0ed-4180-a5d0-936a3ed73f8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:48.308991 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-23094686-e0ed-4180-a5d0-936a3ed73f8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:48.310026 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-23094686-e0ed-4180-a5d0-936a3ed73f8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:48.314031 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-23094686-e0ed-4180-a5d0-936a3ed73f8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:48.314652 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-23094686-e0ed-4180-a5d0-936a3ed73f8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:48.314978 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-23094686-e0ed-4180-a5d0-936a3ed73f8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:48.398159 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-047967bc-7175-4fa1-a556-c20cc408ff04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:48.399925 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-047967bc-7175-4fa1-a556-c20cc408ff04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:48.407887 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-047967bc-7175-4fa1-a556-c20cc408ff04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:48.408615 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-047967bc-7175-4fa1-a556-c20cc408ff04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:48.409088 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-047967bc-7175-4fa1-a556-c20cc408ff04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:48.416045 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-047967bc-7175-4fa1-a556-c20cc408ff04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:48.416045 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-047967bc-7175-4fa1-a556-c20cc408ff04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:48.416045 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-047967bc-7175-4fa1-a556-c20cc408ff04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:48.444771 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-047967bc-7175-4fa1-a556-c20cc408ff04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] HTTP exception thrown: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-047967bc-7175-4fa1-a556-c20cc408ff04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Request method failure captured: Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: DELETE /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 HTTP/1.1 Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKAP7HgYtc4-4-k7Pvw-tZEzRcER0oItatmvKceu0BM_7NqmPQSF9ui1_MKz4TXUi5Z_JuvPOc5RAU-6izpdrTjOyvsO3qVrKLzI_aKsakPLD0cbn0JT5PYSdN6NHyN4a_sJAcK6d8UQV7ALtSTJXAWkW3m-4b8hIBQotWtutxEyqM Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: ab840c288db6497bbd3a4b221cddf009 Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:13:48.446352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:13:48.447640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:13:48.447640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:48.447640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: ab840c288db6497bbd3a4b221cddf009 Oct 14 03:13:48.447640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:48.447640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-AttachVolumeTestJSON-2137333315-project Oct 14 03:13:48.447640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:13:48.447640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:13:48.447640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 2c196d842c4540b5800b4efa0ec4fc73 Oct 14 03:13:48.447640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-AttachVolumeTestJSON-2137333315-project Oct 14 03:13:48.447640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:13:48.447640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:48.447640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': '1ce9443a-d60b-446c-84b0-3620d5233c37'} Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:48.448491 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:48.449835 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:48.451452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-047967bc-7175-4fa1-a556-c20cc408ff04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Returning 404 to user: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:48.451452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-047967bc-7175-4fa1-a556-c20cc408ff04 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 404 len: 111 microversion: 2.1 time: 0.053818 Oct 14 03:13:48.451452 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 445/905] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:13:48 2022] DELETE /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:13:48.456663 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-62c57c86-e005-4e6c-a2c3-0ce1eb72d1b5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:48.457283 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-62c57c86-e005-4e6c-a2c3-0ce1eb72d1b5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 1ce9443a-d60b-446c-84b0-3620d5233c37] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:48.477181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-62c57c86-e005-4e6c-a2c3-0ce1eb72d1b5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:48.477715 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-62c57c86-e005-4e6c-a2c3-0ce1eb72d1b5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:48.478173 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-62c57c86-e005-4e6c-a2c3-0ce1eb72d1b5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:48.480276 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-62c57c86-e005-4e6c-a2c3-0ce1eb72d1b5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:48.482181 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-62c57c86-e005-4e6c-a2c3-0ce1eb72d1b5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:48.482628 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-62c57c86-e005-4e6c-a2c3-0ce1eb72d1b5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:48.508930 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-62c57c86-e005-4e6c-a2c3-0ce1eb72d1b5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] HTTP exception thrown: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-62c57c86-e005-4e6c-a2c3-0ce1eb72d1b5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Request method failure captured: Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 HTTP/1.1 Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKAP7HgYtc4-4-k7Pvw-tZEzRcER0oItatmvKceu0BM_7NqmPQSF9ui1_MKz4TXUi5Z_JuvPOc5RAU-6izpdrTjOyvsO3qVrKLzI_aKsakPLD0cbn0JT5PYSdN6NHyN4a_sJAcK6d8UQV7ALtSTJXAWkW3m-4b8hIBQotWtutxEyqM Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: ab840c288db6497bbd3a4b221cddf009 Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:13:48.510798 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:13:48.512226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:13:48.512226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:48.512226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: ab840c288db6497bbd3a4b221cddf009 Oct 14 03:13:48.512226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:48.512226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-AttachVolumeTestJSON-2137333315-project Oct 14 03:13:48.512226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:13:48.512226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:13:48.512226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 2c196d842c4540b5800b4efa0ec4fc73 Oct 14 03:13:48.512226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-AttachVolumeTestJSON-2137333315-project Oct 14 03:13:48.512226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:13:48.512226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:48.512226 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': '1ce9443a-d60b-446c-84b0-3620d5233c37'} Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:48.518606 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. Oct 14 03:13:48.519997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:48.521159 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-62c57c86-e005-4e6c-a2c3-0ce1eb72d1b5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Returning 404 to user: Instance 1ce9443a-d60b-446c-84b0-3620d5233c37 could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:48.521159 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-62c57c86-e005-4e6c-a2c3-0ce1eb72d1b5 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37" status: 404 len: 111 microversion: 2.1 time: 0.063027 Oct 14 03:13:48.521159 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 446/906] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:48 2022] GET /compute/v2.1/servers/1ce9443a-d60b-446c-84b0-3620d5233c37 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:13:48.537406 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-23094686-e0ed-4180-a5d0-936a3ed73f8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:48.548062 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-23094686-e0ed-4180-a5d0-936a3ed73f8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:48.550147 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-23094686-e0ed-4180-a5d0-936a3ed73f8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:48.551751 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-23094686-e0ed-4180-a5d0-936a3ed73f8c tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1740 microversion: 2.20 time: 0.260424 Oct 14 03:13:48.553830 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 461/907] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:48 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:48.938398 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-478856f3-a043-40ee-9adb-737e05dc730a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6c2af13-68a3-4a5d-84b6-a2ab9cfd9553"}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:48.940749 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-478856f3-a043-40ee-9adb-737e05dc730a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:48.946851 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-478856f3-a043-40ee-9adb-737e05dc730a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:48.947344 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-478856f3-a043-40ee-9adb-737e05dc730a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:48.947785 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-478856f3-a043-40ee-9adb-737e05dc730a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:48.948579 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-478856f3-a043-40ee-9adb-737e05dc730a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:48.949319 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-478856f3-a043-40ee-9adb-737e05dc730a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:48.949732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-478856f3-a043-40ee-9adb-737e05dc730a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:48.968516 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:49.579062 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f480df51-b78a-4093-86c2-eb569501b82f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:49.579684 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f480df51-b78a-4093-86c2-eb569501b82f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:49.586533 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f480df51-b78a-4093-86c2-eb569501b82f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:49.587120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f480df51-b78a-4093-86c2-eb569501b82f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:49.587445 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f480df51-b78a-4093-86c2-eb569501b82f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:49.588153 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f480df51-b78a-4093-86c2-eb569501b82f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:49.588707 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f480df51-b78a-4093-86c2-eb569501b82f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:49.589129 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f480df51-b78a-4093-86c2-eb569501b82f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:49.800407 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f480df51-b78a-4093-86c2-eb569501b82f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:49.810706 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f480df51-b78a-4093-86c2-eb569501b82f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:49.812288 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f480df51-b78a-4093-86c2-eb569501b82f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:49.813855 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f480df51-b78a-4093-86c2-eb569501b82f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1722 microversion: 2.20 time: 0.239342 Oct 14 03:13:49.814612 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 462/908] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:49 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:49.852013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-478856f3-a043-40ee-9adb-737e05dc730a tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "POST /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.913672 Oct 14 03:13:49.852013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 447/909] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Oct 14 03:13:48 2022] POST /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d/os-volume_attachments => generated 194 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:49.954228 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-7f7e365d-b1a6-49b4-8a43-b10c691d240e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:49.954870 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-7f7e365d-b1a6-49b4-8a43-b10c691d240e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:49.964024 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7f7e365d-b1a6-49b4-8a43-b10c691d240e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:49.964558 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7f7e365d-b1a6-49b4-8a43-b10c691d240e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:49.965003 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7f7e365d-b1a6-49b4-8a43-b10c691d240e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:49.970061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7f7e365d-b1a6-49b4-8a43-b10c691d240e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:49.970061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7f7e365d-b1a6-49b4-8a43-b10c691d240e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:49.970061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-7f7e365d-b1a6-49b4-8a43-b10c691d240e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:49.991476 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-7f7e365d-b1a6-49b4-8a43-b10c691d240e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] HTTP exception thrown: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-7f7e365d-b1a6-49b4-8a43-b10c691d240e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Request method failure captured: Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: DELETE /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 HTTP/1.1 Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNKAP7HgYtc4-4-k7Pvw-tZEzRcER0oItatmvKceu0BM_7NqmPQSF9ui1_MKz4TXUi5Z_JuvPOc5RAU-6izpdrTjOyvsO3qVrKLzI_aKsakPLD0cbn0JT5PYSdN6NHyN4a_sJAcK6d8UQV7ALtSTJXAWkW3m-4b8hIBQotWtutxEyqM Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: ab840c288db6497bbd3a4b221cddf009 Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:13:49.993234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:13:49.999653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:13:49.999653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:49.999653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: ab840c288db6497bbd3a4b221cddf009 Oct 14 03:13:49.999653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:49.999653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-AttachVolumeTestJSON-2137333315-project Oct 14 03:13:49.999653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:13:49.999653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:13:49.999653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 2c196d842c4540b5800b4efa0ec4fc73 Oct 14 03:13:49.999653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-AttachVolumeTestJSON-2137333315-project Oct 14 03:13:49.999653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:13:49.999653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:13:49.999653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '62bd9290-c0f1-4e49-ac21-ffaad0578417'} Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:50.000446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:13:50.001772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:13:50.003019 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-7f7e365d-b1a6-49b4-8a43-b10c691d240e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Returning 404 to user: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:50.003019 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-7f7e365d-b1a6-49b4-8a43-b10c691d240e tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "DELETE /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 404 len: 111 microversion: 2.1 time: 0.046194 Oct 14 03:13:50.003019 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 463/910] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:13:49 2022] DELETE /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:50.006474 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-992bbb6d-bf04-4243-bdf1-a9073378de75 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:50.007251 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-992bbb6d-bf04-4243-bdf1-a9073378de75 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] [instance: 62bd9290-c0f1-4e49-ac21-ffaad0578417] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:50.014453 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-992bbb6d-bf04-4243-bdf1-a9073378de75 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:50.015291 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-992bbb6d-bf04-4243-bdf1-a9073378de75 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:50.016135 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-992bbb6d-bf04-4243-bdf1-a9073378de75 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:50.016922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-992bbb6d-bf04-4243-bdf1-a9073378de75 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:50.017387 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-992bbb6d-bf04-4243-bdf1-a9073378de75 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:50.017845 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-992bbb6d-bf04-4243-bdf1-a9073378de75 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:50.032655 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-992bbb6d-bf04-4243-bdf1-a9073378de75 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] HTTP exception thrown: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-992bbb6d-bf04-4243-bdf1-a9073378de75 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Request method failure captured: Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 HTTP/1.1 Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKAP7HgYtc4-4-k7Pvw-tZEzRcER0oItatmvKceu0BM_7NqmPQSF9ui1_MKz4TXUi5Z_JuvPOc5RAU-6izpdrTjOyvsO3qVrKLzI_aKsakPLD0cbn0JT5PYSdN6NHyN4a_sJAcK6d8UQV7ALtSTJXAWkW3m-4b8hIBQotWtutxEyqM Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: ab840c288db6497bbd3a4b221cddf009 Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:13:50.034359 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:13:50.035806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ab840c288db6497bbd3a4b221cddf009"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:13:50.035806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:50.035806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: ab840c288db6497bbd3a4b221cddf009 Oct 14 03:13:50.035806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2137333315 Oct 14 03:13:50.035806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-AttachVolumeTestJSON-2137333315-project Oct 14 03:13:50.035806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:13:50.035806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:13:50.035806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 2c196d842c4540b5800b4efa0ec4fc73 Oct 14 03:13:50.035806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-AttachVolumeTestJSON-2137333315-project Oct 14 03:13:50.035806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:13:50.035806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:13:50.035806 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': '62bd9290-c0f1-4e49-ac21-ffaad0578417'} Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:50.040558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. Oct 14 03:13:50.041921 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:13:50.045138 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-992bbb6d-bf04-4243-bdf1-a9073378de75 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] Returning 404 to user: Instance 62bd9290-c0f1-4e49-ac21-ffaad0578417 could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:50.045138 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-992bbb6d-bf04-4243-bdf1-a9073378de75 tempest-AttachVolumeTestJSON-2137333315 tempest-AttachVolumeTestJSON-2137333315-project] 10.222.0.13 "GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417" status: 404 len: 111 microversion: 2.1 time: 0.035532 Oct 14 03:13:50.045138 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 448/911] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:49 2022] GET /compute/v2.1/servers/62bd9290-c0f1-4e49-ac21-ffaad0578417 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:50.844001 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-13e711a9-1066-4538-ac18-31e7f0e1f3b0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:50.845246 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-13e711a9-1066-4538-ac18-31e7f0e1f3b0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:50.858536 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-13e711a9-1066-4538-ac18-31e7f0e1f3b0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:50.860232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-13e711a9-1066-4538-ac18-31e7f0e1f3b0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:50.862806 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-13e711a9-1066-4538-ac18-31e7f0e1f3b0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:50.866492 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-13e711a9-1066-4538-ac18-31e7f0e1f3b0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:50.869020 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-13e711a9-1066-4538-ac18-31e7f0e1f3b0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:50.873848 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-13e711a9-1066-4538-ac18-31e7f0e1f3b0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:51.286771 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-13e711a9-1066-4538-ac18-31e7f0e1f3b0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:51.312414 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-13e711a9-1066-4538-ac18-31e7f0e1f3b0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:51.319929 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-13e711a9-1066-4538-ac18-31e7f0e1f3b0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:51.323245 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-13e711a9-1066-4538-ac18-31e7f0e1f3b0 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1722 microversion: 2.20 time: 0.484186 Oct 14 03:13:51.324623 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 464/912] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:50 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1722 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:52.351996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-66f358be-8660-4de1-af27-a92be9747036 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:52.352763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-66f358be-8660-4de1-af27-a92be9747036 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:52.362445 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66f358be-8660-4de1-af27-a92be9747036 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:52.376448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66f358be-8660-4de1-af27-a92be9747036 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:52.376448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66f358be-8660-4de1-af27-a92be9747036 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:52.376448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66f358be-8660-4de1-af27-a92be9747036 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:52.376448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66f358be-8660-4de1-af27-a92be9747036 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:52.376941 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66f358be-8660-4de1-af27-a92be9747036 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:52.767774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-66f358be-8660-4de1-af27-a92be9747036 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:52.779346 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-66f358be-8660-4de1-af27-a92be9747036 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:52.780831 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-66f358be-8660-4de1-af27-a92be9747036 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:52.792660 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-66f358be-8660-4de1-af27-a92be9747036 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1725 microversion: 2.20 time: 0.444518 Oct 14 03:13:52.796847 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 449/913] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:52 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1725 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:52.827364 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-bdc5cefc-9880-47ef-aefd-baba3749942e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba1c5e78-690d-4815-982d-c521bdd6c3c9"}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:52.828827 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-bdc5cefc-9880-47ef-aefd-baba3749942e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:52.837960 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bdc5cefc-9880-47ef-aefd-baba3749942e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:52.840063 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bdc5cefc-9880-47ef-aefd-baba3749942e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:52.840063 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bdc5cefc-9880-47ef-aefd-baba3749942e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:52.840063 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bdc5cefc-9880-47ef-aefd-baba3749942e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:52.841093 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bdc5cefc-9880-47ef-aefd-baba3749942e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:52.841804 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-bdc5cefc-9880-47ef-aefd-baba3749942e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:53.384531 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-6c84e346-fa74-44d0-9e08-b125792f666d req-74bab548-9906-46b6-acad-ef3ee08a6230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c6bac7-dcd5-4fd2-b81d-682898442716", "name": "network-vif-unplugged", "status": "completed", "tag": "a0776357-4e9e-4296-84d0-654e4b00c042"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:53.400230 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-6c84e346-fa74-44d0-9e08-b125792f666d req-74bab548-9906-46b6-acad-ef3ee08a6230 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:53.405440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-6c84e346-fa74-44d0-9e08-b125792f666d req-74bab548-9906-46b6-acad-ef3ee08a6230 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:53.406247 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-6c84e346-fa74-44d0-9e08-b125792f666d req-74bab548-9906-46b6-acad-ef3ee08a6230 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:53.419430 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.compute.server_external_events [req-6c84e346-fa74-44d0-9e08-b125792f666d req-74bab548-9906-46b6-acad-ef3ee08a6230 service nova] Unable to find a host for instance b7c6bac7-dcd5-4fd2-b81d-682898442716. Dropping event network-vif-unplugged {{(pid=119302) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 14 03:13:53.424052 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-6c84e346-fa74-44d0-9e08-b125792f666d req-74bab548-9906-46b6-acad-ef3ee08a6230 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042238 Oct 14 03:13:53.424052 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 450/914] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 14 03:13:54.116947 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:54.216059 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-bdc5cefc-9880-47ef-aefd-baba3749942e tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "POST /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.395333 Oct 14 03:13:54.216743 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 465/915] 10.222.0.13 () {62 vars in 1364 bytes} [Fri Oct 14 03:13:52 2022] POST /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716/os-volume_attachments => generated 188 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:13:54.457304 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6cc9d4ee-8376-469e-91d0-f33871aa80a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:54.462460 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6cc9d4ee-8376-469e-91d0-f33871aa80a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:54.477310 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6cc9d4ee-8376-469e-91d0-f33871aa80a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:54.477912 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6cc9d4ee-8376-469e-91d0-f33871aa80a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:54.479972 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6cc9d4ee-8376-469e-91d0-f33871aa80a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:54.480999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6cc9d4ee-8376-469e-91d0-f33871aa80a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:54.481546 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6cc9d4ee-8376-469e-91d0-f33871aa80a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:54.482168 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6cc9d4ee-8376-469e-91d0-f33871aa80a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:54.796158 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9584dd84-c852-4e7d-bab7-41aa59d44328 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:54.797347 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-9584dd84-c852-4e7d-bab7-41aa59d44328 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:54.805129 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9584dd84-c852-4e7d-bab7-41aa59d44328 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:54.807684 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9584dd84-c852-4e7d-bab7-41aa59d44328 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:54.808222 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9584dd84-c852-4e7d-bab7-41aa59d44328 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:54.810069 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9584dd84-c852-4e7d-bab7-41aa59d44328 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:54.815923 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9584dd84-c852-4e7d-bab7-41aa59d44328 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:54.816510 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9584dd84-c852-4e7d-bab7-41aa59d44328 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:54.949352 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-9584dd84-c852-4e7d-bab7-41aa59d44328 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lazy-loading 'services' on Instance uuid b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:55.205384 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9584dd84-c852-4e7d-bab7-41aa59d44328 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d/os-volume_attachments/e6c2af13-68a3-4a5d-84b6-a2ab9cfd9553" status: 202 len: 0 microversion: 2.1 time: 0.414937 Oct 14 03:13:55.206631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 466/916] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Oct 14 03:13:54 2022] DELETE /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d/os-volume_attachments/e6c2af13-68a3-4a5d-84b6-a2ab9cfd9553 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:13:55.421761 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6cc9d4ee-8376-469e-91d0-f33871aa80a9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716/os-volume_attachments/ba1c5e78-690d-4815-982d-c521bdd6c3c9" status: 202 len: 0 microversion: 2.20 time: 0.968302 Oct 14 03:13:55.425902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 451/917] 10.222.0.13 () {60 vars in 1457 bytes} [Fri Oct 14 03:13:54 2022] DELETE /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716/os-volume_attachments/ba1c5e78-690d-4815-982d-c521bdd6c3c9 => generated 0 bytes in 970 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:13:55.431558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d3cf4531-5ae2-4561-98aa-d9df6cbd3a89 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:55.434574 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d3cf4531-5ae2-4561-98aa-d9df6cbd3a89 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:55.445377 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d3cf4531-5ae2-4561-98aa-d9df6cbd3a89 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:55.446514 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d3cf4531-5ae2-4561-98aa-d9df6cbd3a89 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:55.447053 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d3cf4531-5ae2-4561-98aa-d9df6cbd3a89 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:55.448022 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d3cf4531-5ae2-4561-98aa-d9df6cbd3a89 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:55.448735 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d3cf4531-5ae2-4561-98aa-d9df6cbd3a89 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:55.449379 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d3cf4531-5ae2-4561-98aa-d9df6cbd3a89 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:55.501163 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d3cf4531-5ae2-4561-98aa-d9df6cbd3a89 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073311 Oct 14 03:13:55.506254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 452/918] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:13:55 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:55.512876 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-03568636-6a59-4f82-beca-c63f60c91f47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:55.513505 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-03568636-6a59-4f82-beca-c63f60c91f47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:55.516942 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c4fae3aa-8fad-444d-a67d-da8f585f3de2 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Action: 'create', calling method: .version_select at 0x7fdcc76bc5e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1589125991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM28CBwr3Icee5w8K6pMPEnN+7MV/s+dmNcvVkc6MemixosA/d/m71vsSubG9EVlQdzFvZwD2bsJcUMfQkbIz2+KVbFioHG1H+xoShHXA0HKnQEENd+rh0IcrHjT/xOIaw=="}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:55.519719 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-03568636-6a59-4f82-beca-c63f60c91f47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:55.520422 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-03568636-6a59-4f82-beca-c63f60c91f47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:55.520864 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-03568636-6a59-4f82-beca-c63f60c91f47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:55.521563 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-03568636-6a59-4f82-beca-c63f60c91f47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:55.522016 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-03568636-6a59-4f82-beca-c63f60c91f47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:55.522439 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-03568636-6a59-4f82-beca-c63f60c91f47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:55.534919 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-c4fae3aa-8fad-444d-a67d-da8f585f3de2 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Getting quotas for project 459af465b6664bf2b571e931c87c52d6. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:13:55.539225 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-c4fae3aa-8fad-444d-a67d-da8f585f3de2 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Getting quotas for user 9b0f893d26f44c9d99a8c855de0fa16f and project 459af465b6664bf2b571e931c87c52d6. Resources: {'key_pairs'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:13:55.635655 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-03568636-6a59-4f82-beca-c63f60c91f47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119302) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 14 03:13:55.696647 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c4fae3aa-8fad-444d-a67d-da8f585f3de2 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.488609 Oct 14 03:13:55.697405 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 467/919] 10.222.0.13 () {60 vars in 1159 bytes} [Fri Oct 14 03:13:55 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:56.079422 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-03568636-6a59-4f82-beca-c63f60c91f47 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "POST /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716/action" status: 202 len: 0 microversion: 2.20 time: 0.570545 Oct 14 03:13:56.080043 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 453/920] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Oct 14 03:13:55 2022] POST /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 14 03:13:56.088266 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-233f8c07-3559-4092-9e97-93e77bff2466 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:56.093287 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-233f8c07-3559-4092-9e97-93e77bff2466 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:56.099435 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-233f8c07-3559-4092-9e97-93e77bff2466 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:56.100090 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-233f8c07-3559-4092-9e97-93e77bff2466 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:56.100633 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-233f8c07-3559-4092-9e97-93e77bff2466 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:56.102323 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-233f8c07-3559-4092-9e97-93e77bff2466 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:56.104893 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-233f8c07-3559-4092-9e97-93e77bff2466 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:56.105381 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-233f8c07-3559-4092-9e97-93e77bff2466 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:56.313052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-233f8c07-3559-4092-9e97-93e77bff2466 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:56.322461 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-233f8c07-3559-4092-9e97-93e77bff2466 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:56.323943 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-233f8c07-3559-4092-9e97-93e77bff2466 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:56.325366 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-233f8c07-3559-4092-9e97-93e77bff2466 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1673 microversion: 2.20 time: 0.241060 Oct 14 03:13:56.325927 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 468/921] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:56 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1673 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:56.516570 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3988377d-c44a-4144-8751-99468dd0c848 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:56.521078 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-3988377d-c44a-4144-8751-99468dd0c848 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:56.542985 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3988377d-c44a-4144-8751-99468dd0c848 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:56.543677 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3988377d-c44a-4144-8751-99468dd0c848 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:56.544177 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3988377d-c44a-4144-8751-99468dd0c848 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:56.545050 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3988377d-c44a-4144-8751-99468dd0c848 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:56.546144 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3988377d-c44a-4144-8751-99468dd0c848 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:56.546667 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3988377d-c44a-4144-8751-99468dd0c848 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:56.647421 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-3988377d-c44a-4144-8751-99468dd0c848 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.137764 Oct 14 03:13:56.648905 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 454/922] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Oct 14 03:13:56 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:13:56.753596 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fc1e9069-cca2-49b0-a58a-25ad99cd208f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:56.754107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fc1e9069-cca2-49b0-a58a-25ad99cd208f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:56.776765 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc1e9069-cca2-49b0-a58a-25ad99cd208f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:56.781142 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc1e9069-cca2-49b0-a58a-25ad99cd208f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:56.783290 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc1e9069-cca2-49b0-a58a-25ad99cd208f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:56.784104 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc1e9069-cca2-49b0-a58a-25ad99cd208f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:56.786187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc1e9069-cca2-49b0-a58a-25ad99cd208f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:56.786647 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fc1e9069-cca2-49b0-a58a-25ad99cd208f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:56.827000 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fc1e9069-cca2-49b0-a58a-25ad99cd208f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Going to try to terminate instance {{(pid=119301) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:13:57.223362 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fc1e9069-cca2-49b0-a58a-25ad99cd208f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 204 len: 0 microversion: 2.1 time: 0.479447 Oct 14 03:13:57.239425 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 469/923] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:13:56 2022] DELETE /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:13:57.239579 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-90fe77c6-e5bf-4f5b-b2aa-40317f6d773b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:57.240099 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-90fe77c6-e5bf-4f5b-b2aa-40317f6d773b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:57.251419 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-90fe77c6-e5bf-4f5b-b2aa-40317f6d773b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:57.252260 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-90fe77c6-e5bf-4f5b-b2aa-40317f6d773b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:57.252730 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-90fe77c6-e5bf-4f5b-b2aa-40317f6d773b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:57.256127 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-90fe77c6-e5bf-4f5b-b2aa-40317f6d773b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:57.256127 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-90fe77c6-e5bf-4f5b-b2aa-40317f6d773b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:57.256127 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-90fe77c6-e5bf-4f5b-b2aa-40317f6d773b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:57.352041 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-420fbe3e-dc22-4bd7-95b6-fe57f32b150b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:57.352907 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-420fbe3e-dc22-4bd7-95b6-fe57f32b150b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:57.362596 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-420fbe3e-dc22-4bd7-95b6-fe57f32b150b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:57.366012 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-420fbe3e-dc22-4bd7-95b6-fe57f32b150b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:57.366557 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-420fbe3e-dc22-4bd7-95b6-fe57f32b150b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:57.367298 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-420fbe3e-dc22-4bd7-95b6-fe57f32b150b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:57.367759 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-420fbe3e-dc22-4bd7-95b6-fe57f32b150b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:57.368187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-420fbe3e-dc22-4bd7-95b6-fe57f32b150b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:57.525127 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-90fe77c6-e5bf-4f5b-b2aa-40317f6d773b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:57.541115 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-90fe77c6-e5bf-4f5b-b2aa-40317f6d773b tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1681 microversion: 2.1 time: 0.305416 Oct 14 03:13:57.542299 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 455/924] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:57 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1681 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:57.569904 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-420fbe3e-dc22-4bd7-95b6-fe57f32b150b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:57.578775 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-420fbe3e-dc22-4bd7-95b6-fe57f32b150b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:57.583788 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-420fbe3e-dc22-4bd7-95b6-fe57f32b150b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:57.585016 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-420fbe3e-dc22-4bd7-95b6-fe57f32b150b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1673 microversion: 2.20 time: 0.237617 Oct 14 03:13:57.585946 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 470/925] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:57 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1673 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:58.066823 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6b0912a7-2d78-42ca-903b-fc197f88b65e tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] Action: 'create', calling method: .version_select at 0x7fdcc74ba9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1936183084", "metadata": {"Type": "work"}}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:58.565219 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ec53a91b-824b-4ad0-98fb-0bc18bdf75c1 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:58.572100 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ec53a91b-824b-4ad0-98fb-0bc18bdf75c1 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:58.572100 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:58.576213 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec53a91b-824b-4ad0-98fb-0bc18bdf75c1 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:58.577841 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec53a91b-824b-4ad0-98fb-0bc18bdf75c1 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:58.578289 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec53a91b-824b-4ad0-98fb-0bc18bdf75c1 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:58.579008 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec53a91b-824b-4ad0-98fb-0bc18bdf75c1 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:58.579465 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec53a91b-824b-4ad0-98fb-0bc18bdf75c1 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:58.579994 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ec53a91b-824b-4ad0-98fb-0bc18bdf75c1 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:58.839978 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ec53a91b-824b-4ad0-98fb-0bc18bdf75c1 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:58.849429 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ec53a91b-824b-4ad0-98fb-0bc18bdf75c1 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1681 microversion: 2.1 time: 0.288220 Oct 14 03:13:58.850620 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 471/926] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:58 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1681 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:58.857100 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b5f076e8-5026-4a44-a068-904621ceecc1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:58.857906 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b5f076e8-5026-4a44-a068-904621ceecc1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:58.870649 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b5f076e8-5026-4a44-a068-904621ceecc1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:58.871144 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6b0912a7-2d78-42ca-903b-fc197f88b65e tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.929428 Oct 14 03:13:58.881611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b5f076e8-5026-4a44-a068-904621ceecc1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:58.881611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b5f076e8-5026-4a44-a068-904621ceecc1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:58.881611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b5f076e8-5026-4a44-a068-904621ceecc1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:58.881889 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 456/927] 10.222.0.13 () {60 vars in 1156 bytes} [Fri Oct 14 03:13:57 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 931 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 14 03:13:58.881970 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b5f076e8-5026-4a44-a068-904621ceecc1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:58.881970 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b5f076e8-5026-4a44-a068-904621ceecc1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:58.886720 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-fdc4191c-903f-4358-8f33-1b15b8ed9972 tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] Calling method '.version_select at 0x7fdcc7546040>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:59.004173 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-fdc4191c-903f-4358-8f33-1b15b8ed9972 tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ebcf8ceb-d238-4d2a-b033-e128a67531e4" status: 200 len: 353 microversion: 2.1 time: 0.121246 Oct 14 03:13:59.004848 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 457/928] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:58 2022] GET /compute/v2.1/os-volumes/ebcf8ceb-d238-4d2a-b033-e128a67531e4 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:13:59.172798 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b5f076e8-5026-4a44-a068-904621ceecc1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:59.179270 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b5f076e8-5026-4a44-a068-904621ceecc1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:59.181577 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b5f076e8-5026-4a44-a068-904621ceecc1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:59.183120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b5f076e8-5026-4a44-a068-904621ceecc1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1673 microversion: 2.20 time: 0.331353 Oct 14 03:13:59.199014 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 472/929] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:58 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1673 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:59.878620 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8aa8fefb-2066-4b37-b951-69a4f98dcd18 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:59.879257 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8aa8fefb-2066-4b37-b951-69a4f98dcd18 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:59.881291 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:59.901039 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8aa8fefb-2066-4b37-b951-69a4f98dcd18 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:59.901718 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8aa8fefb-2066-4b37-b951-69a4f98dcd18 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:59.902338 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8aa8fefb-2066-4b37-b951-69a4f98dcd18 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:59.903237 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8aa8fefb-2066-4b37-b951-69a4f98dcd18 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:59.903862 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8aa8fefb-2066-4b37-b951-69a4f98dcd18 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:59.904475 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8aa8fefb-2066-4b37-b951-69a4f98dcd18 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:00.001724 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8aa8fefb-2066-4b37-b951-69a4f98dcd18 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:00.015599 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8aa8fefb-2066-4b37-b951-69a4f98dcd18 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1614 microversion: 2.1 time: 0.142671 Oct 14 03:14:00.017061 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 458/930] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:59 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1614 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:00.028449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-4f7791ca-1cf8-4772-8e51-383c30b22d0b tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] Calling method '.version_select at 0x7fdcc7739dc0>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:00.107052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-4f7791ca-1cf8-4772-8e51-383c30b22d0b tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ebcf8ceb-d238-4d2a-b033-e128a67531e4" status: 200 len: 354 microversion: 2.1 time: 0.092191 Oct 14 03:14:00.108260 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 473/931] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Oct 14 03:14:00 2022] GET /compute/v2.1/os-volumes/ebcf8ceb-d238-4d2a-b033-e128a67531e4 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:14:00.121597 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2b2391d2-f40a-4b1e-83ca-40212947c41f tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] Calling method '.version_select at 0x7fdcc737a040>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:00.212560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2b2391d2-f40a-4b1e-83ca-40212947c41f tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ebcf8ceb-d238-4d2a-b033-e128a67531e4" status: 200 len: 354 microversion: 2.1 time: 0.092846 Oct 14 03:14:00.228965 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 459/932] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Oct 14 03:14:00 2022] GET /compute/v2.1/os-volumes/ebcf8ceb-d238-4d2a-b033-e128a67531e4 => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:00.230152 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-dd6f549a-e25a-43c7-9a86-2d271f2d3937 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:00.230776 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-dd6f549a-e25a-43c7-9a86-2d271f2d3937 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:00.239021 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9393cd0e-aeaf-4657-ad7f-05cc386428ab tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] Calling method '.version_select at 0x7fdcc74bad30>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:00.251895 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dd6f549a-e25a-43c7-9a86-2d271f2d3937 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:00.255253 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dd6f549a-e25a-43c7-9a86-2d271f2d3937 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:00.255708 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dd6f549a-e25a-43c7-9a86-2d271f2d3937 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:00.256522 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dd6f549a-e25a-43c7-9a86-2d271f2d3937 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:00.256990 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dd6f549a-e25a-43c7-9a86-2d271f2d3937 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:00.257422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-dd6f549a-e25a-43c7-9a86-2d271f2d3937 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:00.532165 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9393cd0e-aeaf-4657-ad7f-05cc386428ab tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/ebcf8ceb-d238-4d2a-b033-e128a67531e4" status: 202 len: 0 microversion: 2.1 time: 0.296983 Oct 14 03:14:00.536615 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 460/933] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Oct 14 03:14:00 2022] DELETE /compute/v2.1/os-volumes/ebcf8ceb-d238-4d2a-b033-e128a67531e4 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:14:00.552225 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e43d3dbc-f117-4649-8208-99ad9243cfb0 tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] Calling method '.version_select at 0x7fdcc75754c0>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:00.559941 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-dd6f549a-e25a-43c7-9a86-2d271f2d3937 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:00.573428 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-dd6f549a-e25a-43c7-9a86-2d271f2d3937 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:00.579395 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-dd6f549a-e25a-43c7-9a86-2d271f2d3937 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:00.584622 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-dd6f549a-e25a-43c7-9a86-2d271f2d3937 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.376405 Oct 14 03:14:00.595451 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 474/934] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:00 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:00.664500 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e43d3dbc-f117-4649-8208-99ad9243cfb0 tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ebcf8ceb-d238-4d2a-b033-e128a67531e4" status: 200 len: 353 microversion: 2.1 time: 0.118493 Oct 14 03:14:00.671295 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 461/935] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Oct 14 03:14:00 2022] GET /compute/v2.1/os-volumes/ebcf8ceb-d238-4d2a-b033-e128a67531e4 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:00.979361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-da16cfc5-030e-4672-987c-aa7d3ffd91c9 req-197cfa5d-e573-462e-bfc5-1b67d46dc899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d", "name": "network-vif-deleted", "tag": "06fd51ef-122c-4339-9704-90cd3f5bc8b9"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:14:00.995646 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-da16cfc5-030e-4672-987c-aa7d3ffd91c9 req-197cfa5d-e573-462e-bfc5-1b67d46dc899 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:00.996518 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-da16cfc5-030e-4672-987c-aa7d3ffd91c9 req-197cfa5d-e573-462e-bfc5-1b67d46dc899 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:00.996952 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-da16cfc5-030e-4672-987c-aa7d3ffd91c9 req-197cfa5d-e573-462e-bfc5-1b67d46dc899 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:01.009270 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-da16cfc5-030e-4672-987c-aa7d3ffd91c9 req-197cfa5d-e573-462e-bfc5-1b67d46dc899 service nova] Creating event network-vif-deleted:06fd51ef-122c-4339-9704-90cd3f5bc8b9 for instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d on hv-cinder-80152 Oct 14 03:14:01.014566 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-da16cfc5-030e-4672-987c-aa7d3ffd91c9 req-197cfa5d-e573-462e-bfc5-1b67d46dc899 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042828 Oct 14 03:14:01.016725 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 475/936] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:01.040185 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-114575ae-951f-4e33-9793-5bfceb395abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:01.042200 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-114575ae-951f-4e33-9793-5bfceb395abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:01.058448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-114575ae-951f-4e33-9793-5bfceb395abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:01.059392 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-114575ae-951f-4e33-9793-5bfceb395abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:01.060354 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-114575ae-951f-4e33-9793-5bfceb395abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:01.061538 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-114575ae-951f-4e33-9793-5bfceb395abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:01.063279 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-114575ae-951f-4e33-9793-5bfceb395abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:01.064225 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-114575ae-951f-4e33-9793-5bfceb395abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:01.309286 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-114575ae-951f-4e33-9793-5bfceb395abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:01.326526 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-114575ae-951f-4e33-9793-5bfceb395abf tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1614 microversion: 2.1 time: 0.289024 Oct 14 03:14:01.329760 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 462/937] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:01 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1614 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:01.627157 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-735e20f2-3e71-43c2-aada-202773ad6967 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:01.628286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-735e20f2-3e71-43c2-aada-202773ad6967 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:01.647943 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-735e20f2-3e71-43c2-aada-202773ad6967 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:01.647943 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-735e20f2-3e71-43c2-aada-202773ad6967 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:01.647943 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-735e20f2-3e71-43c2-aada-202773ad6967 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:01.649666 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-735e20f2-3e71-43c2-aada-202773ad6967 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:01.650362 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-735e20f2-3e71-43c2-aada-202773ad6967 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:01.650624 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-735e20f2-3e71-43c2-aada-202773ad6967 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:01.682394 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d7659bf0-e175-432e-abda-7f2ca381202a tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] Calling method '.version_select at 0x7fdcc7575af0>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:01.722069 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-d7659bf0-e175-432e-abda-7f2ca381202a tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] HTTP exception thrown: Volume ebcf8ceb-d238-4d2a-b033-e128a67531e4 could not be found. Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d7659bf0-e175-432e-abda-7f2ca381202a tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] Request method failure captured: Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/os-volumes/ebcf8ceb-d238-4d2a-b033-e128a67531e4 HTTP/1.1 Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNP1RbXUCGLy3A5Jx3hjZ2UWHrF_95_ezT7S5Q9NN7eEDW76zx3aFESyyl55ScqkdJ8WLnpFb8pZ5AyVphi3oIjZc00kDZjMwjqdVI7T5uImvtZVHJUFzC3Lv6DkvYsK05fQ0xRIu6KZ-ggp9jjx5-Ar3Amwtp2wxAzAm4cUNEYOHk0 Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: a537324689d2495da97034bd54e55586 Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-VolumesGetTestJSON-895721531 Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:14:01.724248 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:14:01.725844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a537324689d2495da97034bd54e55586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a537324689d2495da97034bd54e55586"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a537324689d2495da97034bd54e55586"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a537324689d2495da97034bd54e55586"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:14:01.725844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-VolumesGetTestJSON-895721531 Oct 14 03:14:01.725844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: a537324689d2495da97034bd54e55586 Oct 14 03:14:01.725844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-VolumesGetTestJSON-895721531 Oct 14 03:14:01.725844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-VolumesGetTestJSON-895721531-project Oct 14 03:14:01.725844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:14:01.725844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:14:01.725844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: acedaf10a17f41c583cbfe54181cb5d8 Oct 14 03:14:01.725844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-VolumesGetTestJSON-895721531-project Oct 14 03:14:01.725844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: Oct 14 03:14:01.725844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Volume ebcf8ceb-d238-4d2a-b033-e128a67531e4 could not be found. Oct 14 03:14:01.725844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': 'ebcf8ceb-d238-4d2a-b033-e128a67531e4'} Oct 14 03:14:01.725844 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ebcf8ceb-d238-4d2a-b033-e128a67531e4 could not be found. (HTTP 404) (Request-ID: req-86e9c500-b5c6-4354-9be8-2c4a3e5e1389) Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:01.726732 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:14:01.728763 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ebcf8ceb-d238-4d2a-b033-e128a67531e4 could not be found. Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 03:14:01.730373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:01.731822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ebcf8ceb-d238-4d2a-b033-e128a67531e4 could not be found. Oct 14 03:14:01.731822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:01.731822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:01.731822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:01.731822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:01.731822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:01.731822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:01.731822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:01.731822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:01.731822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ebcf8ceb-d238-4d2a-b033-e128a67531e4 could not be found. Oct 14 03:14:01.731822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:01.731822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d7659bf0-e175-432e-abda-7f2ca381202a tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] Returning 404 to user: Volume ebcf8ceb-d238-4d2a-b033-e128a67531e4 could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:01.731822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d7659bf0-e175-432e-abda-7f2ca381202a tempest-VolumesGetTestJSON-895721531 tempest-VolumesGetTestJSON-895721531-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ebcf8ceb-d238-4d2a-b033-e128a67531e4" status: 404 len: 109 microversion: 2.1 time: 0.051080 Oct 14 03:14:01.733354 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 463/938] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Oct 14 03:14:01 2022] GET /compute/v2.1/os-volumes/ebcf8ceb-d238-4d2a-b033-e128a67531e4 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:01.852126 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-735e20f2-3e71-43c2-aada-202773ad6967 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:01.860348 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-735e20f2-3e71-43c2-aada-202773ad6967 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:01.864081 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-735e20f2-3e71-43c2-aada-202773ad6967 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:01.864081 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-735e20f2-3e71-43c2-aada-202773ad6967 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.240792 Oct 14 03:14:01.864081 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 476/939] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:01 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:02.351637 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f3b59761-d573-40b9-8433-08e8a04dedf6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:02.352610 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f3b59761-d573-40b9-8433-08e8a04dedf6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:02.359673 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3b59761-d573-40b9-8433-08e8a04dedf6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:02.360263 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3b59761-d573-40b9-8433-08e8a04dedf6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:02.360803 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3b59761-d573-40b9-8433-08e8a04dedf6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:02.361594 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3b59761-d573-40b9-8433-08e8a04dedf6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:02.362199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3b59761-d573-40b9-8433-08e8a04dedf6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:02.362841 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3b59761-d573-40b9-8433-08e8a04dedf6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:02.395307 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3b59761-d573-40b9-8433-08e8a04dedf6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:02.395795 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3b59761-d573-40b9-8433-08e8a04dedf6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:02.396239 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f3b59761-d573-40b9-8433-08e8a04dedf6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:02.396712 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-f3b59761-d573-40b9-8433-08e8a04dedf6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lazy-loading 'fault' on Instance uuid b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:14:02.466480 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-f3b59761-d573-40b9-8433-08e8a04dedf6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4553b7573ca34af6a9fdb94f80717f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480aef72b62f45e09f59cfa48ba9a854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:02.482391 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f3b59761-d573-40b9-8433-08e8a04dedf6 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 200 len: 1331 microversion: 2.1 time: 0.131909 Oct 14 03:14:02.482391 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 464/940] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:02 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 1331 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:02.888508 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d9d20067-d5f7-4283-852b-432ba3c3cca8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:02.893989 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d9d20067-d5f7-4283-852b-432ba3c3cca8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:02.909696 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9d20067-d5f7-4283-852b-432ba3c3cca8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:02.912535 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9d20067-d5f7-4283-852b-432ba3c3cca8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:02.913010 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9d20067-d5f7-4283-852b-432ba3c3cca8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:02.913820 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9d20067-d5f7-4283-852b-432ba3c3cca8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:02.914324 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9d20067-d5f7-4283-852b-432ba3c3cca8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:02.914771 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d9d20067-d5f7-4283-852b-432ba3c3cca8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:03.155247 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d9d20067-d5f7-4283-852b-432ba3c3cca8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:03.164706 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d9d20067-d5f7-4283-852b-432ba3c3cca8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:03.166560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d9d20067-d5f7-4283-852b-432ba3c3cca8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:03.168083 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d9d20067-d5f7-4283-852b-432ba3c3cca8 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.283918 Oct 14 03:14:03.169210 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 477/941] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:02 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:03.506613 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-92e86f72-6ce6-4d7e-9751-7019d3609ecc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:03.509341 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-92e86f72-6ce6-4d7e-9751-7019d3609ecc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:03.522809 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-92e86f72-6ce6-4d7e-9751-7019d3609ecc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:03.523396 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-92e86f72-6ce6-4d7e-9751-7019d3609ecc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:03.523942 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-92e86f72-6ce6-4d7e-9751-7019d3609ecc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:03.529521 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-92e86f72-6ce6-4d7e-9751-7019d3609ecc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:03.530619 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-92e86f72-6ce6-4d7e-9751-7019d3609ecc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:03.532461 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-92e86f72-6ce6-4d7e-9751-7019d3609ecc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:03.553374 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-92e86f72-6ce6-4d7e-9751-7019d3609ecc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] HTTP exception thrown: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-92e86f72-6ce6-4d7e-9751-7019d3609ecc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Request method failure captured: Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d HTTP/1.1 Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKG-ky05sope_YdGjGweAljK5FUxzsY0TE3JqS7jM4jPzALKbCEnItlHGzo5Xg-IOfB8MCgv3mdaVNqvdBnmYZMENHyFWRo7_9tNs76BHsJnl6Osbo5VySDApF7HiliGWSEh0OSOTvdEIMsVWp5oVBM2GccEYCsyuR5X3gKYrX8g9g Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:14:03.554936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:14:03.556335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:14:03.556335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:03.556335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:03.556335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:03.556335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:03.556335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:14:03.556335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:14:03.556335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 4553b7573ca34af6a9fdb94f80717f24 Oct 14 03:14:03.556335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:03.556335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:14:03.556335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:03.556335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': 'b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d'} Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:03.557317 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:03.558779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:03.560083 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-92e86f72-6ce6-4d7e-9751-7019d3609ecc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Returning 404 to user: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:03.560083 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-92e86f72-6ce6-4d7e-9751-7019d3609ecc tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 404 len: 111 microversion: 2.1 time: 0.054174 Oct 14 03:14:03.560520 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 465/942] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:03 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:03.566777 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-28490f03-b7d0-4704-832b-570322799644 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '.version_select at 0x7fdcc74f1f70>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:03.648495 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-28490f03-b7d0-4704-832b-570322799644 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848355125" status: 202 len: 0 microversion: 2.1 time: 0.086356 Oct 14 03:14:03.649811 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 478/943] 10.222.0.13 () {58 vars in 1221 bytes} [Fri Oct 14 03:14:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848355125 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:14:04.197139 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c48db4a5-f649-4043-b501-3a46c97a21eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:04.198537 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c48db4a5-f649-4043-b501-3a46c97a21eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:04.206986 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c48db4a5-f649-4043-b501-3a46c97a21eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:04.207964 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c48db4a5-f649-4043-b501-3a46c97a21eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:04.208751 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c48db4a5-f649-4043-b501-3a46c97a21eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:04.209773 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c48db4a5-f649-4043-b501-3a46c97a21eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:04.210528 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c48db4a5-f649-4043-b501-3a46c97a21eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:04.211245 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c48db4a5-f649-4043-b501-3a46c97a21eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:04.437644 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c48db4a5-f649-4043-b501-3a46c97a21eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:04.441875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:04.450963 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c48db4a5-f649-4043-b501-3a46c97a21eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:04.456244 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c48db4a5-f649-4043-b501-3a46c97a21eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:04.462925 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c48db4a5-f649-4043-b501-3a46c97a21eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.266592 Oct 14 03:14:04.462925 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 466/944] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:04 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:05.488449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ddc5906f-1772-4ffd-923f-ccd7959845c6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:05.489083 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ddc5906f-1772-4ffd-923f-ccd7959845c6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:05.499328 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ddc5906f-1772-4ffd-923f-ccd7959845c6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:05.499816 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ddc5906f-1772-4ffd-923f-ccd7959845c6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:05.500260 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ddc5906f-1772-4ffd-923f-ccd7959845c6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:05.502607 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ddc5906f-1772-4ffd-923f-ccd7959845c6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:05.506253 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ddc5906f-1772-4ffd-923f-ccd7959845c6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:05.506886 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ddc5906f-1772-4ffd-923f-ccd7959845c6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:05.561993 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=4 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:05.749362 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ddc5906f-1772-4ffd-923f-ccd7959845c6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:05.761860 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ddc5906f-1772-4ffd-923f-ccd7959845c6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:05.763864 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ddc5906f-1772-4ffd-923f-ccd7959845c6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:05.765991 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ddc5906f-1772-4ffd-923f-ccd7959845c6 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.282834 Oct 14 03:14:05.778119 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 479/945] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:05 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:06.286210 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a9542750-db23-4898-b48d-91d71ca8b901 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:06.288328 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-a9542750-db23-4898-b48d-91d71ca8b901 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:06.298937 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a9542750-db23-4898-b48d-91d71ca8b901 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:06.298937 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a9542750-db23-4898-b48d-91d71ca8b901 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:06.299383 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a9542750-db23-4898-b48d-91d71ca8b901 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:06.300787 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a9542750-db23-4898-b48d-91d71ca8b901 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:06.301497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a9542750-db23-4898-b48d-91d71ca8b901 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:06.303106 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a9542750-db23-4898-b48d-91d71ca8b901 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:06.325357 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-a9542750-db23-4898-b48d-91d71ca8b901 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] HTTP exception thrown: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a9542750-db23-4898-b48d-91d71ca8b901 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Request method failure captured: Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: DELETE /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d HTTP/1.1 Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKG-ky05sope_YdGjGweAljK5FUxzsY0TE3JqS7jM4jPzALKbCEnItlHGzo5Xg-IOfB8MCgv3mdaVNqvdBnmYZMENHyFWRo7_9tNs76BHsJnl6Osbo5VySDApF7HiliGWSEh0OSOTvdEIMsVWp5oVBM2GccEYCsyuR5X3gKYrX8g9g Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:14:06.327852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:14:06.329399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:14:06.329399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:06.329399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:06.329399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:06.329399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:06.329399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:14:06.329399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:14:06.329399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 4553b7573ca34af6a9fdb94f80717f24 Oct 14 03:14:06.329399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:06.329399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:14:06.329399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:06.329399 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': 'b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d'} Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:06.330294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:06.331592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:06.334561 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a9542750-db23-4898-b48d-91d71ca8b901 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Returning 404 to user: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:06.334561 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-a9542750-db23-4898-b48d-91d71ca8b901 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 404 len: 111 microversion: 2.1 time: 0.049566 Oct 14 03:14:06.334561 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 467/946] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:14:06 2022] DELETE /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:06.344855 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-09d1051a-c0c6-4443-b718-967e0165f6e8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:06.344975 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-09d1051a-c0c6-4443-b718-967e0165f6e8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:06.351292 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09d1051a-c0c6-4443-b718-967e0165f6e8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:06.351825 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09d1051a-c0c6-4443-b718-967e0165f6e8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:06.352364 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09d1051a-c0c6-4443-b718-967e0165f6e8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:06.353362 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09d1051a-c0c6-4443-b718-967e0165f6e8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:06.354042 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09d1051a-c0c6-4443-b718-967e0165f6e8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:06.354685 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09d1051a-c0c6-4443-b718-967e0165f6e8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:06.375748 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-09d1051a-c0c6-4443-b718-967e0165f6e8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] HTTP exception thrown: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-09d1051a-c0c6-4443-b718-967e0165f6e8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Request method failure captured: Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d HTTP/1.1 Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNKG-ky05sope_YdGjGweAljK5FUxzsY0TE3JqS7jM4jPzALKbCEnItlHGzo5Xg-IOfB8MCgv3mdaVNqvdBnmYZMENHyFWRo7_9tNs76BHsJnl6Osbo5VySDApF7HiliGWSEh0OSOTvdEIMsVWp5oVBM2GccEYCsyuR5X3gKYrX8g9g Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:14:06.378611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:14:06.380312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:14:06.380312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:06.380312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:06.380312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:06.380312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:06.380312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:14:06.380312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:14:06.380312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 4553b7573ca34af6a9fdb94f80717f24 Oct 14 03:14:06.380312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:06.380312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:14:06.380312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:06.380312 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': 'b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d'} Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:06.381232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. Oct 14 03:14:06.382674 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:06.383943 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-09d1051a-c0c6-4443-b718-967e0165f6e8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Returning 404 to user: Instance b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:06.383943 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-09d1051a-c0c6-4443-b718-967e0165f6e8 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d" status: 404 len: 111 microversion: 2.1 time: 0.045017 Oct 14 03:14:06.383943 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 480/947] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:06 2022] GET /compute/v2.1/servers/b5e7fd8f-d953-4b7e-9cef-c2b632b6ff8d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:06.796744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-4d2c8932-46c3-412a-b853-7f5fce7c57a1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:06.797479 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-4d2c8932-46c3-412a-b853-7f5fce7c57a1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:06.809881 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4d2c8932-46c3-412a-b853-7f5fce7c57a1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:06.810410 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4d2c8932-46c3-412a-b853-7f5fce7c57a1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:06.810908 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4d2c8932-46c3-412a-b853-7f5fce7c57a1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:06.811673 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4d2c8932-46c3-412a-b853-7f5fce7c57a1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:06.812130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4d2c8932-46c3-412a-b853-7f5fce7c57a1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:06.812731 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4d2c8932-46c3-412a-b853-7f5fce7c57a1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:06.996829 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4d2c8932-46c3-412a-b853-7f5fce7c57a1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:07.006063 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4d2c8932-46c3-412a-b853-7f5fce7c57a1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:07.007511 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4d2c8932-46c3-412a-b853-7f5fce7c57a1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:07.009041 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-4d2c8932-46c3-412a-b853-7f5fce7c57a1 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.217730 Oct 14 03:14:07.009771 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 468/948] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:06 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:07.867186 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-280d616c-267f-458f-978e-c8910409de03 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:07.867766 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-280d616c-267f-458f-978e-c8910409de03 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:07.878514 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-280d616c-267f-458f-978e-c8910409de03 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:07.879114 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-280d616c-267f-458f-978e-c8910409de03 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:07.879628 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-280d616c-267f-458f-978e-c8910409de03 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:07.880447 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-280d616c-267f-458f-978e-c8910409de03 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:07.881614 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-280d616c-267f-458f-978e-c8910409de03 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:07.882385 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-280d616c-267f-458f-978e-c8910409de03 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:07.911716 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-280d616c-267f-458f-978e-c8910409de03 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] HTTP exception thrown: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-280d616c-267f-458f-978e-c8910409de03 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Request method failure captured: Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: DELETE /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee HTTP/1.1 Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNKG-ky05sope_YdGjGweAljK5FUxzsY0TE3JqS7jM4jPzALKbCEnItlHGzo5Xg-IOfB8MCgv3mdaVNqvdBnmYZMENHyFWRo7_9tNs76BHsJnl6Osbo5VySDApF7HiliGWSEh0OSOTvdEIMsVWp5oVBM2GccEYCsyuR5X3gKYrX8g9g Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:14:07.913884 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:14:07.915871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:14:07.915871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:07.915871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:07.915871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:07.915871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:07.915871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:14:07.915871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:14:07.915871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 4553b7573ca34af6a9fdb94f80717f24 Oct 14 03:14:07.915871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:07.915871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:14:07.915871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:14:07.915871 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '3200a8b9-6447-41fb-8433-36b0283813ee'} Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:07.917052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:14:07.918773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:07.921047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-280d616c-267f-458f-978e-c8910409de03 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Returning 404 to user: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:07.922272 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-280d616c-267f-458f-978e-c8910409de03 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 404 len: 111 microversion: 2.1 time: 0.059950 Oct 14 03:14:07.923410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 481/949] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:14:07 2022] DELETE /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:14:07.933438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2df3916e-21a1-46cb-92fd-ac9cafd84421 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:07.939833 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2df3916e-21a1-46cb-92fd-ac9cafd84421 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 3200a8b9-6447-41fb-8433-36b0283813ee] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:07.948086 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2df3916e-21a1-46cb-92fd-ac9cafd84421 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:07.948886 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2df3916e-21a1-46cb-92fd-ac9cafd84421 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:07.949513 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2df3916e-21a1-46cb-92fd-ac9cafd84421 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:07.950395 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2df3916e-21a1-46cb-92fd-ac9cafd84421 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:07.951063 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2df3916e-21a1-46cb-92fd-ac9cafd84421 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:07.952416 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2df3916e-21a1-46cb-92fd-ac9cafd84421 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:07.971682 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-2df3916e-21a1-46cb-92fd-ac9cafd84421 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] HTTP exception thrown: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2df3916e-21a1-46cb-92fd-ac9cafd84421 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Request method failure captured: Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee HTTP/1.1 Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKG-ky05sope_YdGjGweAljK5FUxzsY0TE3JqS7jM4jPzALKbCEnItlHGzo5Xg-IOfB8MCgv3mdaVNqvdBnmYZMENHyFWRo7_9tNs76BHsJnl6Osbo5VySDApF7HiliGWSEh0OSOTvdEIMsVWp5oVBM2GccEYCsyuR5X3gKYrX8g9g Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:14:07.973804 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:14:07.975499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:14:07.975499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:07.975499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:07.975499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:07.975499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:07.975499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:14:07.975499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:14:07.975499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 4553b7573ca34af6a9fdb94f80717f24 Oct 14 03:14:07.975499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:07.975499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:14:07.975499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:14:07.975499 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': '3200a8b9-6447-41fb-8433-36b0283813ee'} Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:07.980922 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. Oct 14 03:14:07.982592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:07.984008 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2df3916e-21a1-46cb-92fd-ac9cafd84421 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Returning 404 to user: Instance 3200a8b9-6447-41fb-8433-36b0283813ee could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:07.984008 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2df3916e-21a1-46cb-92fd-ac9cafd84421 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee" status: 404 len: 111 microversion: 2.1 time: 0.051169 Oct 14 03:14:07.988643 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 469/950] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:07 2022] GET /compute/v2.1/servers/3200a8b9-6447-41fb-8433-36b0283813ee => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:07.998085 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-65240baf-e680-4151-a8c1-eaf12078fb5f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:07.998868 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-65240baf-e680-4151-a8c1-eaf12078fb5f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:08.007807 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-65240baf-e680-4151-a8c1-eaf12078fb5f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:08.008314 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-65240baf-e680-4151-a8c1-eaf12078fb5f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:08.008837 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-65240baf-e680-4151-a8c1-eaf12078fb5f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:08.009900 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-65240baf-e680-4151-a8c1-eaf12078fb5f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:08.010356 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-65240baf-e680-4151-a8c1-eaf12078fb5f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:08.010965 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-65240baf-e680-4151-a8c1-eaf12078fb5f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:08.032229 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-65240baf-e680-4151-a8c1-eaf12078fb5f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] HTTP exception thrown: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-65240baf-e680-4151-a8c1-eaf12078fb5f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Request method failure captured: Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: DELETE /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 HTTP/1.1 Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNKG-ky05sope_YdGjGweAljK5FUxzsY0TE3JqS7jM4jPzALKbCEnItlHGzo5Xg-IOfB8MCgv3mdaVNqvdBnmYZMENHyFWRo7_9tNs76BHsJnl6Osbo5VySDApF7HiliGWSEh0OSOTvdEIMsVWp5oVBM2GccEYCsyuR5X3gKYrX8g9g Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:14:08.035945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:14:08.037410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:14:08.037410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:08.037410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:08.037410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:08.037410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:08.037410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:14:08.037410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:14:08.037410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 4553b7573ca34af6a9fdb94f80717f24 Oct 14 03:14:08.037410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:08.037410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:14:08.037410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:14:08.037410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': 'f165841c-8922-4baa-909d-daf6b2e6b924'} Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:08.038168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:14:08.039455 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:08.047266 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-65240baf-e680-4151-a8c1-eaf12078fb5f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Returning 404 to user: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:08.047266 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-65240baf-e680-4151-a8c1-eaf12078fb5f tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 404 len: 111 microversion: 2.1 time: 0.045175 Oct 14 03:14:08.047266 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 482/951] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:14:07 2022] DELETE /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:08.049443 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-4e02bc43-6654-43f5-94ef-e0252ecf6e05 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:08.050536 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-4e02bc43-6654-43f5-94ef-e0252ecf6e05 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:08.051013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e0cfa0f2-098c-4130-922f-1cebafbb09b3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:08.051882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e0cfa0f2-098c-4130-922f-1cebafbb09b3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: f165841c-8922-4baa-909d-daf6b2e6b924] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:08.058559 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4e02bc43-6654-43f5-94ef-e0252ecf6e05 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:08.059328 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4e02bc43-6654-43f5-94ef-e0252ecf6e05 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:08.059984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4e02bc43-6654-43f5-94ef-e0252ecf6e05 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:08.061626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4e02bc43-6654-43f5-94ef-e0252ecf6e05 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:08.062881 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e0cfa0f2-098c-4130-922f-1cebafbb09b3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:08.063382 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e0cfa0f2-098c-4130-922f-1cebafbb09b3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:08.063857 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e0cfa0f2-098c-4130-922f-1cebafbb09b3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:08.064660 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e0cfa0f2-098c-4130-922f-1cebafbb09b3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:08.065114 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e0cfa0f2-098c-4130-922f-1cebafbb09b3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:08.065529 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e0cfa0f2-098c-4130-922f-1cebafbb09b3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:08.075426 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4e02bc43-6654-43f5-94ef-e0252ecf6e05 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:08.075944 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4e02bc43-6654-43f5-94ef-e0252ecf6e05 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:08.085945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-e0cfa0f2-098c-4130-922f-1cebafbb09b3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] HTTP exception thrown: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e0cfa0f2-098c-4130-922f-1cebafbb09b3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Request method failure captured: Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 HTTP/1.1 Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNKG-ky05sope_YdGjGweAljK5FUxzsY0TE3JqS7jM4jPzALKbCEnItlHGzo5Xg-IOfB8MCgv3mdaVNqvdBnmYZMENHyFWRo7_9tNs76BHsJnl6Osbo5VySDApF7HiliGWSEh0OSOTvdEIMsVWp5oVBM2GccEYCsyuR5X3gKYrX8g9g Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:14:08.087498 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:14:08.089209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:14:08.089209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:08.089209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:08.089209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:08.089209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:08.089209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:14:08.089209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:14:08.089209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 4553b7573ca34af6a9fdb94f80717f24 Oct 14 03:14:08.089209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:08.089209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:14:08.089209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:14:08.089209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': 'f165841c-8922-4baa-909d-daf6b2e6b924'} Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:08.093130 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. Oct 14 03:14:08.094573 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:14:08.096720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e0cfa0f2-098c-4130-922f-1cebafbb09b3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Returning 404 to user: Instance f165841c-8922-4baa-909d-daf6b2e6b924 could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:08.096720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e0cfa0f2-098c-4130-922f-1cebafbb09b3 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924" status: 404 len: 111 microversion: 2.1 time: 0.042479 Oct 14 03:14:08.096720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 483/952] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:08 2022] GET /compute/v2.1/servers/f165841c-8922-4baa-909d-daf6b2e6b924 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:08.308373 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4e02bc43-6654-43f5-94ef-e0252ecf6e05 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:08.324225 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4e02bc43-6654-43f5-94ef-e0252ecf6e05 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:08.336216 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4e02bc43-6654-43f5-94ef-e0252ecf6e05 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:08.337818 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-4e02bc43-6654-43f5-94ef-e0252ecf6e05 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.306536 Oct 14 03:14:08.338400 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 470/953] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:08 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:14:09.372483 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ea845507-1a2a-45cc-bd25-a809af1bf417 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:09.373830 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ea845507-1a2a-45cc-bd25-a809af1bf417 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:09.386748 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea845507-1a2a-45cc-bd25-a809af1bf417 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:09.387487 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea845507-1a2a-45cc-bd25-a809af1bf417 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:09.388145 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea845507-1a2a-45cc-bd25-a809af1bf417 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:09.389220 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea845507-1a2a-45cc-bd25-a809af1bf417 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:09.389873 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea845507-1a2a-45cc-bd25-a809af1bf417 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:09.390972 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea845507-1a2a-45cc-bd25-a809af1bf417 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:09.481698 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b7431c30-5ca1-45fd-b7d7-5fdeacc46b98 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:09.482914 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b7431c30-5ca1-45fd-b7d7-5fdeacc46b98 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:09.493542 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b7431c30-5ca1-45fd-b7d7-5fdeacc46b98 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:09.509273 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b7431c30-5ca1-45fd-b7d7-5fdeacc46b98 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:09.512880 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b7431c30-5ca1-45fd-b7d7-5fdeacc46b98 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:09.513866 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b7431c30-5ca1-45fd-b7d7-5fdeacc46b98 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:09.514543 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b7431c30-5ca1-45fd-b7d7-5fdeacc46b98 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:09.515209 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b7431c30-5ca1-45fd-b7d7-5fdeacc46b98 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:09.534696 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-b7431c30-5ca1-45fd-b7d7-5fdeacc46b98 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] HTTP exception thrown: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b7431c30-5ca1-45fd-b7d7-5fdeacc46b98 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Request method failure captured: Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: DELETE /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d HTTP/1.1 Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKG-ky05sope_YdGjGweAljK5FUxzsY0TE3JqS7jM4jPzALKbCEnItlHGzo5Xg-IOfB8MCgv3mdaVNqvdBnmYZMENHyFWRo7_9tNs76BHsJnl6Osbo5VySDApF7HiliGWSEh0OSOTvdEIMsVWp5oVBM2GccEYCsyuR5X3gKYrX8g9g Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:14:09.537875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:14:09.539254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:14:09.539254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:09.539254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:09.539254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:09.539254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:09.539254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:14:09.539254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:14:09.539254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 4553b7573ca34af6a9fdb94f80717f24 Oct 14 03:14:09.539254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:09.539254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:14:09.539254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:14:09.539254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': '95f00fbd-d2ed-4c85-b341-8b02b1c2c20d'} Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:09.540191 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:14:09.541497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:09.547192 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b7431c30-5ca1-45fd-b7d7-5fdeacc46b98 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Returning 404 to user: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:09.548830 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b7431c30-5ca1-45fd-b7d7-5fdeacc46b98 tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "DELETE /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 404 len: 111 microversion: 2.1 time: 0.073095 Oct 14 03:14:09.550092 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 471/954] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:14:09 2022] DELETE /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:09.567669 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d2ec857e-abf8-412a-aa34-e9d60ac6b5fa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:09.569907 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d2ec857e-abf8-412a-aa34-e9d60ac6b5fa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] [instance: 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:09.586638 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d2ec857e-abf8-412a-aa34-e9d60ac6b5fa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:09.587678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d2ec857e-abf8-412a-aa34-e9d60ac6b5fa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:09.588152 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d2ec857e-abf8-412a-aa34-e9d60ac6b5fa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:09.593228 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d2ec857e-abf8-412a-aa34-e9d60ac6b5fa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:09.594123 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d2ec857e-abf8-412a-aa34-e9d60ac6b5fa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:09.595194 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d2ec857e-abf8-412a-aa34-e9d60ac6b5fa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:09.613296 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-d2ec857e-abf8-412a-aa34-e9d60ac6b5fa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] HTTP exception thrown: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d2ec857e-abf8-412a-aa34-e9d60ac6b5fa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Request method failure captured: Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d HTTP/1.1 Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKG-ky05sope_YdGjGweAljK5FUxzsY0TE3JqS7jM4jPzALKbCEnItlHGzo5Xg-IOfB8MCgv3mdaVNqvdBnmYZMENHyFWRo7_9tNs76BHsJnl6Osbo5VySDApF7HiliGWSEh0OSOTvdEIMsVWp5oVBM2GccEYCsyuR5X3gKYrX8g9g Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:14:09.615300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:14:09.616714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_480aef72b62f45e09f59cfa48ba9a854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:14:09.616714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:09.616714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: 480aef72b62f45e09f59cfa48ba9a854 Oct 14 03:14:09.616714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1839594129 Oct 14 03:14:09.616714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:09.616714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:14:09.616714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:14:09.616714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 4553b7573ca34af6a9fdb94f80717f24 Oct 14 03:14:09.616714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-AttachVolumeNegativeTest-1839594129-project Oct 14 03:14:09.616714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:14:09.616714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:14:09.616714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': '95f00fbd-d2ed-4c85-b341-8b02b1c2c20d'} Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:09.617486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. Oct 14 03:14:09.618700 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:14:09.619914 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d2ec857e-abf8-412a-aa34-e9d60ac6b5fa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] Returning 404 to user: Instance 95f00fbd-d2ed-4c85-b341-8b02b1c2c20d could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:09.619914 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d2ec857e-abf8-412a-aa34-e9d60ac6b5fa tempest-AttachVolumeNegativeTest-1839594129 tempest-AttachVolumeNegativeTest-1839594129-project] 10.222.0.13 "GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d" status: 404 len: 111 microversion: 2.1 time: 0.059839 Oct 14 03:14:09.619914 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 472/955] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:09 2022] GET /compute/v2.1/servers/95f00fbd-d2ed-4c85-b341-8b02b1c2c20d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:09.677340 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ea845507-1a2a-45cc-bd25-a809af1bf417 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:09.693015 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ea845507-1a2a-45cc-bd25-a809af1bf417 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:09.694620 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ea845507-1a2a-45cc-bd25-a809af1bf417 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:09.699432 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ea845507-1a2a-45cc-bd25-a809af1bf417 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.333802 Oct 14 03:14:09.700016 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 484/956] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:09 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:10.728189 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e6376691-842c-4866-b863-a0903b923e8a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:10.729220 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e6376691-842c-4866-b863-a0903b923e8a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:10.743400 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e6376691-842c-4866-b863-a0903b923e8a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:10.750354 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e6376691-842c-4866-b863-a0903b923e8a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:10.750354 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e6376691-842c-4866-b863-a0903b923e8a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:10.750354 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e6376691-842c-4866-b863-a0903b923e8a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:10.750354 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e6376691-842c-4866-b863-a0903b923e8a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:10.750818 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e6376691-842c-4866-b863-a0903b923e8a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:11.114849 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e6376691-842c-4866-b863-a0903b923e8a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:11.124144 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e6376691-842c-4866-b863-a0903b923e8a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:11.126188 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e6376691-842c-4866-b863-a0903b923e8a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:11.128158 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e6376691-842c-4866-b863-a0903b923e8a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.404862 Oct 14 03:14:11.129304 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 473/957] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:10 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:12.161015 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-60ae9beb-d4c0-4806-a52d-5aa4763b8766 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:12.161824 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-60ae9beb-d4c0-4806-a52d-5aa4763b8766 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:12.171183 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-60ae9beb-d4c0-4806-a52d-5aa4763b8766 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:12.172251 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-60ae9beb-d4c0-4806-a52d-5aa4763b8766 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:12.172929 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-60ae9beb-d4c0-4806-a52d-5aa4763b8766 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:12.181526 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-60ae9beb-d4c0-4806-a52d-5aa4763b8766 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:12.181526 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-60ae9beb-d4c0-4806-a52d-5aa4763b8766 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:12.181526 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-60ae9beb-d4c0-4806-a52d-5aa4763b8766 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:12.367859 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-60ae9beb-d4c0-4806-a52d-5aa4763b8766 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:12.375703 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:12.382845 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-60ae9beb-d4c0-4806-a52d-5aa4763b8766 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:12.387251 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-60ae9beb-d4c0-4806-a52d-5aa4763b8766 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:12.390697 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-60ae9beb-d4c0-4806-a52d-5aa4763b8766 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.235256 Oct 14 03:14:12.394472 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 485/958] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:12 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:13.419788 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3137c799-21d4-46a5-bbc0-5bd391568070 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:13.419788 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-3137c799-21d4-46a5-bbc0-5bd391568070 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:13.431416 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3137c799-21d4-46a5-bbc0-5bd391568070 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:13.431905 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3137c799-21d4-46a5-bbc0-5bd391568070 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:13.432843 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3137c799-21d4-46a5-bbc0-5bd391568070 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:13.433808 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3137c799-21d4-46a5-bbc0-5bd391568070 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:13.434495 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3137c799-21d4-46a5-bbc0-5bd391568070 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:13.435134 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3137c799-21d4-46a5-bbc0-5bd391568070 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:13.653020 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3137c799-21d4-46a5-bbc0-5bd391568070 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:13.669312 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3137c799-21d4-46a5-bbc0-5bd391568070 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:13.671440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3137c799-21d4-46a5-bbc0-5bd391568070 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:13.675884 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-3137c799-21d4-46a5-bbc0-5bd391568070 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.261935 Oct 14 03:14:13.677822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 474/959] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:13 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:14.703202 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-c46db76b-6694-4f5a-b12e-9ab31ae2b1f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:14.705432 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-c46db76b-6694-4f5a-b12e-9ab31ae2b1f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:14.713849 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c46db76b-6694-4f5a-b12e-9ab31ae2b1f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:14.714850 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c46db76b-6694-4f5a-b12e-9ab31ae2b1f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:14.717234 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c46db76b-6694-4f5a-b12e-9ab31ae2b1f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:14.722047 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c46db76b-6694-4f5a-b12e-9ab31ae2b1f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:14.722745 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c46db76b-6694-4f5a-b12e-9ab31ae2b1f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:14.723401 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-c46db76b-6694-4f5a-b12e-9ab31ae2b1f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:14.876578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c46db76b-6694-4f5a-b12e-9ab31ae2b1f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:14.885409 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c46db76b-6694-4f5a-b12e-9ab31ae2b1f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:14.886854 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-c46db76b-6694-4f5a-b12e-9ab31ae2b1f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:14.888025 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-c46db76b-6694-4f5a-b12e-9ab31ae2b1f9 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.188735 Oct 14 03:14:14.888618 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 486/960] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:14 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:15.413612 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1260387981", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1589125991", "security_groups": [{"name": "tempest-secgroup-smoke-2049958615"}], "networks": [{"uuid": "4d9b0cd8-38fa-4fc1-b131-c73c73121b79"}], "block_device_mapping_v2": [{"uuid": "c0117ceb-81fe-4e02-94f3-50b7f59c4521", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:14:15.552044 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.network.neutron [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] validate_networks() for [('4d9b0cd8-38fa-4fc1-b131-c73c73121b79', None, None, None, None, None)] {{(pid=119302) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:14:15.915924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-cf009257-60a2-40f8-ae5f-5a624cced168 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:15.916605 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-cf009257-60a2-40f8-ae5f-5a624cced168 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:15.928764 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cf009257-60a2-40f8-ae5f-5a624cced168 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:15.928764 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cf009257-60a2-40f8-ae5f-5a624cced168 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:15.928764 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cf009257-60a2-40f8-ae5f-5a624cced168 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:15.928764 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cf009257-60a2-40f8-ae5f-5a624cced168 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:15.929094 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cf009257-60a2-40f8-ae5f-5a624cced168 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:15.929094 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-cf009257-60a2-40f8-ae5f-5a624cced168 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:16.007878 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Flavor limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:14:16.008174 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Image limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:14:16.008674 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Flavor pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:14:16.009422 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Image pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:14:16.010324 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:14:16.020132 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:16.020984 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:16.021599 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:16.022334 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:16.023019 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:16.023657 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:16.049132 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Getting quotas for project 459af465b6664bf2b571e931c87c52d6. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:14:16.054311 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Getting quotas for user 9b0f893d26f44c9d99a8c855de0fa16f and project 459af465b6664bf2b571e931c87c52d6. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:14:16.107975 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-cf009257-60a2-40f8-ae5f-5a624cced168 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:16.116860 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-cf009257-60a2-40f8-ae5f-5a624cced168 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:16.118315 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-cf009257-60a2-40f8-ae5f-5a624cced168 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:16.119717 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-cf009257-60a2-40f8-ae5f-5a624cced168 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.208678 Oct 14 03:14:16.120281 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 487/961] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:15 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:14:16.128834 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Going to run 1 instances... {{(pid=119302) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:14:16.131178 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0117ceb-81fe-4e02-94f3-50b7f59c4521',volume_size=None,volume_type=None)] {{(pid=119302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:14:16.537639 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-45a7ebf0-57c0-4727-bcb3-879b85e3cf9c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.128056 Oct 14 03:14:16.549895 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b5fb928d-451c-4ea2-a545-cd629d05b48a tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:16.550520 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b5fb928d-451c-4ea2-a545-cd629d05b48a tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:16.562797 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 475/962] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:14:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:14:16.630808 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b5fb928d-451c-4ea2-a545-cd629d05b48a tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:16.638138 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b5fb928d-451c-4ea2-a545-cd629d05b48a tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1089 microversion: 2.1 time: 0.092501 Oct 14 03:14:16.638937 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 488/963] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:16 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1089 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:16.947612 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-61fbd0f2-dec6-4e7c-abd8-59e6bc0138bf req-7f3e0f20-aa48-4d42-b3a7-65da3e67acd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c6bac7-dcd5-4fd2-b81d-682898442716", "name": "network-vif-plugged", "status": "completed", "tag": "a0776357-4e9e-4296-84d0-654e4b00c042"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:14:16.958015 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-61fbd0f2-dec6-4e7c-abd8-59e6bc0138bf req-7f3e0f20-aa48-4d42-b3a7-65da3e67acd2 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:16.958599 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-61fbd0f2-dec6-4e7c-abd8-59e6bc0138bf req-7f3e0f20-aa48-4d42-b3a7-65da3e67acd2 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:16.959045 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-61fbd0f2-dec6-4e7c-abd8-59e6bc0138bf req-7f3e0f20-aa48-4d42-b3a7-65da3e67acd2 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:16.970923 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-61fbd0f2-dec6-4e7c-abd8-59e6bc0138bf req-7f3e0f20-aa48-4d42-b3a7-65da3e67acd2 service nova] Creating event network-vif-plugged:a0776357-4e9e-4296-84d0-654e4b00c042 for instance b7c6bac7-dcd5-4fd2-b81d-682898442716 on hv-cinder-80152 Oct 14 03:14:16.977559 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-61fbd0f2-dec6-4e7c-abd8-59e6bc0138bf req-7f3e0f20-aa48-4d42-b3a7-65da3e67acd2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033530 Oct 14 03:14:16.977977 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 476/964] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:17.146474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0ee023d3-5f68-438c-8d68-174792789ecd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:17.148586 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0ee023d3-5f68-438c-8d68-174792789ecd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:17.155621 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0ee023d3-5f68-438c-8d68-174792789ecd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:17.156110 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0ee023d3-5f68-438c-8d68-174792789ecd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:17.156575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0ee023d3-5f68-438c-8d68-174792789ecd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:17.157295 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0ee023d3-5f68-438c-8d68-174792789ecd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:17.157732 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0ee023d3-5f68-438c-8d68-174792789ecd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:17.158153 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0ee023d3-5f68-438c-8d68-174792789ecd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:17.319331 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0ee023d3-5f68-438c-8d68-174792789ecd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:17.330780 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0ee023d3-5f68-438c-8d68-174792789ecd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:17.336410 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0ee023d3-5f68-438c-8d68-174792789ecd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:17.338083 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0ee023d3-5f68-438c-8d68-174792789ecd tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.196181 Oct 14 03:14:17.339186 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 489/965] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:17 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:17.665737 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-15c75b86-5d54-41e1-a5c8-5ffc8c45fe16 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:17.673951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-15c75b86-5d54-41e1-a5c8-5ffc8c45fe16 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:17.722644 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-15c75b86-5d54-41e1-a5c8-5ffc8c45fe16 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:17.731186 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-15c75b86-5d54-41e1-a5c8-5ffc8c45fe16 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1089 microversion: 2.1 time: 0.069767 Oct 14 03:14:17.732206 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 477/966] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:17 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:18.365947 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-0b3c5280-e173-41c7-b777-598b569fa264 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:18.367209 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-0b3c5280-e173-41c7-b777-598b569fa264 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:18.373783 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0b3c5280-e173-41c7-b777-598b569fa264 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:18.374293 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0b3c5280-e173-41c7-b777-598b569fa264 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:18.374892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0b3c5280-e173-41c7-b777-598b569fa264 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:18.375615 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0b3c5280-e173-41c7-b777-598b569fa264 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:18.376076 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0b3c5280-e173-41c7-b777-598b569fa264 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:18.376534 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-0b3c5280-e173-41c7-b777-598b569fa264 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:18.755735 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0b3c5280-e173-41c7-b777-598b569fa264 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:18.758067 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-0efd95e9-8793-45c8-9ce6-49ec6958657e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:18.758677 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-0efd95e9-8793-45c8-9ce6-49ec6958657e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:18.764211 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0b3c5280-e173-41c7-b777-598b569fa264 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:18.777418 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-0b3c5280-e173-41c7-b777-598b569fa264 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:18.777590 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0efd95e9-8793-45c8-9ce6-49ec6958657e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:18.777590 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0efd95e9-8793-45c8-9ce6-49ec6958657e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:18.777590 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0efd95e9-8793-45c8-9ce6-49ec6958657e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:18.777894 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-0b3c5280-e173-41c7-b777-598b569fa264 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.405782 Oct 14 03:14:18.778013 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0efd95e9-8793-45c8-9ce6-49ec6958657e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:18.778108 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 490/967] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:18 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:18.778199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0efd95e9-8793-45c8-9ce6-49ec6958657e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:18.778199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-0efd95e9-8793-45c8-9ce6-49ec6958657e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:18.828182 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-0efd95e9-8793-45c8-9ce6-49ec6958657e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:18.835987 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-0efd95e9-8793-45c8-9ce6-49ec6958657e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1131 microversion: 2.1 time: 0.081736 Oct 14 03:14:18.837004 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 478/968] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:18 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1131 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:14:19.793357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9c3d5197-e2d1-44fb-9fe7-2651c93b908b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:19.793882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-9c3d5197-e2d1-44fb-9fe7-2651c93b908b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:19.801274 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9c3d5197-e2d1-44fb-9fe7-2651c93b908b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:19.801763 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9c3d5197-e2d1-44fb-9fe7-2651c93b908b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:19.805011 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9c3d5197-e2d1-44fb-9fe7-2651c93b908b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:19.806088 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9c3d5197-e2d1-44fb-9fe7-2651c93b908b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:19.806202 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9c3d5197-e2d1-44fb-9fe7-2651c93b908b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:19.806593 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9c3d5197-e2d1-44fb-9fe7-2651c93b908b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:19.859411 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-3fb484e9-32bc-40bc-bef9-138c5cfa591e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:19.862033 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-3fb484e9-32bc-40bc-bef9-138c5cfa591e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:19.867437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fb484e9-32bc-40bc-bef9-138c5cfa591e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:19.867936 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fb484e9-32bc-40bc-bef9-138c5cfa591e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:19.868430 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fb484e9-32bc-40bc-bef9-138c5cfa591e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:19.869113 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fb484e9-32bc-40bc-bef9-138c5cfa591e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:19.869577 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fb484e9-32bc-40bc-bef9-138c5cfa591e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:19.870045 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-3fb484e9-32bc-40bc-bef9-138c5cfa591e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:19.977456 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-3fb484e9-32bc-40bc-bef9-138c5cfa591e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:19.986440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-3fb484e9-32bc-40bc-bef9-138c5cfa591e tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1195 microversion: 2.1 time: 0.131096 Oct 14 03:14:19.987638 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 479/969] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:19 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1195 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:14:20.095219 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-9c3d5197-e2d1-44fb-9fe7-2651c93b908b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:20.139687 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-9c3d5197-e2d1-44fb-9fe7-2651c93b908b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:20.142512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-9c3d5197-e2d1-44fb-9fe7-2651c93b908b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:20.143868 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9c3d5197-e2d1-44fb-9fe7-2651c93b908b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1731 microversion: 2.20 time: 0.354504 Oct 14 03:14:20.148788 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 491/970] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:19 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1731 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:21.014955 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ea667337-3d4f-4ba8-9236-8934f34c53c8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:21.015596 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ea667337-3d4f-4ba8-9236-8934f34c53c8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:21.022904 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea667337-3d4f-4ba8-9236-8934f34c53c8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:21.023388 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea667337-3d4f-4ba8-9236-8934f34c53c8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:21.023827 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea667337-3d4f-4ba8-9236-8934f34c53c8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:21.024666 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea667337-3d4f-4ba8-9236-8934f34c53c8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:21.025118 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea667337-3d4f-4ba8-9236-8934f34c53c8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:21.025541 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea667337-3d4f-4ba8-9236-8934f34c53c8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:21.170943 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b5bd0b01-50c1-4e89-9875-9ed6acfb04b3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:21.171612 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b5bd0b01-50c1-4e89-9875-9ed6acfb04b3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:21.178458 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b5bd0b01-50c1-4e89-9875-9ed6acfb04b3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:21.178987 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b5bd0b01-50c1-4e89-9875-9ed6acfb04b3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:21.179431 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b5bd0b01-50c1-4e89-9875-9ed6acfb04b3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:21.180140 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b5bd0b01-50c1-4e89-9875-9ed6acfb04b3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:21.180833 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b5bd0b01-50c1-4e89-9875-9ed6acfb04b3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:21.181421 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b5bd0b01-50c1-4e89-9875-9ed6acfb04b3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:21.194165 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ea667337-3d4f-4ba8-9236-8934f34c53c8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:21.201901 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ea667337-3d4f-4ba8-9236-8934f34c53c8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1273 microversion: 2.1 time: 0.190705 Oct 14 03:14:21.202880 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 480/971] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:21 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:21.347652 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b5bd0b01-50c1-4e89-9875-9ed6acfb04b3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:21.360575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b5bd0b01-50c1-4e89-9875-9ed6acfb04b3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:21.360575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b5bd0b01-50c1-4e89-9875-9ed6acfb04b3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:21.360575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b5bd0b01-50c1-4e89-9875-9ed6acfb04b3 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1718 microversion: 2.20 time: 0.191856 Oct 14 03:14:21.368524 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 492/972] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:21 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1718 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:14:22.238621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c0be7461-7ff4-42ce-bd0d-8ecca29fa4e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:22.238621 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c0be7461-7ff4-42ce-bd0d-8ecca29fa4e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:22.241494 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c0be7461-7ff4-42ce-bd0d-8ecca29fa4e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:22.241997 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c0be7461-7ff4-42ce-bd0d-8ecca29fa4e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:22.244677 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-042cb48e-bfb3-449f-b090-56bb28eae514 req-f63ef3fb-1695-4c49-b58d-04d8ee52e0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c2c238c-787c-4bb0-b123-61e7d380c8b7", "tag": "49070fc8-b204-45c9-b9e0-f8e67c3fa614"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:14:22.245748 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c0be7461-7ff4-42ce-bd0d-8ecca29fa4e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:22.246862 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c0be7461-7ff4-42ce-bd0d-8ecca29fa4e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:22.247314 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c0be7461-7ff4-42ce-bd0d-8ecca29fa4e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:22.247750 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-c0be7461-7ff4-42ce-bd0d-8ecca29fa4e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:22.255501 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-042cb48e-bfb3-449f-b090-56bb28eae514 req-f63ef3fb-1695-4c49-b58d-04d8ee52e0e1 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:22.256226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-042cb48e-bfb3-449f-b090-56bb28eae514 req-f63ef3fb-1695-4c49-b58d-04d8ee52e0e1 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:22.256868 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-042cb48e-bfb3-449f-b090-56bb28eae514 req-f63ef3fb-1695-4c49-b58d-04d8ee52e0e1 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:22.275882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-042cb48e-bfb3-449f-b090-56bb28eae514 req-f63ef3fb-1695-4c49-b58d-04d8ee52e0e1 service nova] Creating event network-changed:49070fc8-b204-45c9-b9e0-f8e67c3fa614 for instance 9c2c238c-787c-4bb0-b123-61e7d380c8b7 on hv-cinder-80152 Oct 14 03:14:22.282211 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-042cb48e-bfb3-449f-b090-56bb28eae514 req-f63ef3fb-1695-4c49-b58d-04d8ee52e0e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040643 Oct 14 03:14:22.283257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 493/973] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:22.425983 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c0be7461-7ff4-42ce-bd0d-8ecca29fa4e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:22.435134 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c0be7461-7ff4-42ce-bd0d-8ecca29fa4e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1261 microversion: 2.1 time: 0.204695 Oct 14 03:14:22.436238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 481/974] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:22 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:23.464686 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-4e28aa6d-38bf-46a3-a12e-bbd79dfd52d5 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:23.465394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-4e28aa6d-38bf-46a3-a12e-bbd79dfd52d5 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:23.471486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4e28aa6d-38bf-46a3-a12e-bbd79dfd52d5 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:23.471971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4e28aa6d-38bf-46a3-a12e-bbd79dfd52d5 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:23.472427 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4e28aa6d-38bf-46a3-a12e-bbd79dfd52d5 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:23.473646 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4e28aa6d-38bf-46a3-a12e-bbd79dfd52d5 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:23.474107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4e28aa6d-38bf-46a3-a12e-bbd79dfd52d5 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:23.474533 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-4e28aa6d-38bf-46a3-a12e-bbd79dfd52d5 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:23.630358 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-4e28aa6d-38bf-46a3-a12e-bbd79dfd52d5 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:23.639939 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-4e28aa6d-38bf-46a3-a12e-bbd79dfd52d5 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1261 microversion: 2.1 time: 0.180046 Oct 14 03:14:23.640809 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 494/975] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:23 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:24.665571 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-09337af6-3715-4c38-8671-a8411f05c3b4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:24.668003 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-09337af6-3715-4c38-8671-a8411f05c3b4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:24.674519 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-09337af6-3715-4c38-8671-a8411f05c3b4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:24.675247 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-09337af6-3715-4c38-8671-a8411f05c3b4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:24.676935 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-09337af6-3715-4c38-8671-a8411f05c3b4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:24.677356 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-09337af6-3715-4c38-8671-a8411f05c3b4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:24.677822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-09337af6-3715-4c38-8671-a8411f05c3b4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:24.678861 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-09337af6-3715-4c38-8671-a8411f05c3b4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:24.815261 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-09337af6-3715-4c38-8671-a8411f05c3b4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:24.823731 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-09337af6-3715-4c38-8671-a8411f05c3b4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1261 microversion: 2.1 time: 0.164256 Oct 14 03:14:24.824884 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 482/976] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:24 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:25.849924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-6e9cdc8f-e8b9-4c78-82f2-76d0965e7b6c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:25.850672 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-6e9cdc8f-e8b9-4c78-82f2-76d0965e7b6c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:25.857978 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6e9cdc8f-e8b9-4c78-82f2-76d0965e7b6c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:25.858473 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6e9cdc8f-e8b9-4c78-82f2-76d0965e7b6c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:25.858907 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6e9cdc8f-e8b9-4c78-82f2-76d0965e7b6c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:25.859652 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6e9cdc8f-e8b9-4c78-82f2-76d0965e7b6c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:25.860129 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6e9cdc8f-e8b9-4c78-82f2-76d0965e7b6c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:25.866870 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6e9cdc8f-e8b9-4c78-82f2-76d0965e7b6c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:26.012317 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-6e9cdc8f-e8b9-4c78-82f2-76d0965e7b6c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:26.020042 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-6e9cdc8f-e8b9-4c78-82f2-76d0965e7b6c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1261 microversion: 2.1 time: 0.174201 Oct 14 03:14:26.020703 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 495/977] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:25 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:27.043462 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d0134381-204d-418f-b8ad-30220f6b3b7a tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:27.044529 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d0134381-204d-418f-b8ad-30220f6b3b7a tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:27.049863 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=2 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:27.051714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d0134381-204d-418f-b8ad-30220f6b3b7a tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:27.052235 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d0134381-204d-418f-b8ad-30220f6b3b7a tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:27.052717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d0134381-204d-418f-b8ad-30220f6b3b7a tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:27.053438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d0134381-204d-418f-b8ad-30220f6b3b7a tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:27.054220 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d0134381-204d-418f-b8ad-30220f6b3b7a tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:27.054652 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d0134381-204d-418f-b8ad-30220f6b3b7a tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:27.210028 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-d0134381-204d-418f-b8ad-30220f6b3b7a tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:27.217636 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d0134381-204d-418f-b8ad-30220f6b3b7a tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1261 microversion: 2.1 time: 0.178231 Oct 14 03:14:27.218205 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 483/978] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:27 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:28.240718 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9d7d0bd7-1210-477d-9d8a-e718ffdec68f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:28.242200 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-9d7d0bd7-1210-477d-9d8a-e718ffdec68f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:28.245412 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=2 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:28.249765 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d7d0bd7-1210-477d-9d8a-e718ffdec68f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:28.250257 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d7d0bd7-1210-477d-9d8a-e718ffdec68f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:28.250896 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d7d0bd7-1210-477d-9d8a-e718ffdec68f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:28.251733 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d7d0bd7-1210-477d-9d8a-e718ffdec68f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:28.252518 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d7d0bd7-1210-477d-9d8a-e718ffdec68f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:28.252755 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9d7d0bd7-1210-477d-9d8a-e718ffdec68f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:28.433760 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-9d7d0bd7-1210-477d-9d8a-e718ffdec68f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:28.442271 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9d7d0bd7-1210-477d-9d8a-e718ffdec68f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1261 microversion: 2.1 time: 0.205487 Oct 14 03:14:28.445785 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 496/979] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:28 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:14:29.220691 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-840f7c14-7b2a-4d6e-9164-d5033d140abc req-b095b2bd-b40f-4127-957d-d8ac22183946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2c238c-787c-4bb0-b123-61e7d380c8b7", "name": "network-vif-plugged", "status": "completed", "tag": "49070fc8-b204-45c9-b9e0-f8e67c3fa614"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:14:29.226056 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=8 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:29.231566 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-840f7c14-7b2a-4d6e-9164-d5033d140abc req-b095b2bd-b40f-4127-957d-d8ac22183946 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:29.232039 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-840f7c14-7b2a-4d6e-9164-d5033d140abc req-b095b2bd-b40f-4127-957d-d8ac22183946 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:29.232503 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-840f7c14-7b2a-4d6e-9164-d5033d140abc req-b095b2bd-b40f-4127-957d-d8ac22183946 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:29.243913 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-840f7c14-7b2a-4d6e-9164-d5033d140abc req-b095b2bd-b40f-4127-957d-d8ac22183946 service nova] Creating event network-vif-plugged:49070fc8-b204-45c9-b9e0-f8e67c3fa614 for instance 9c2c238c-787c-4bb0-b123-61e7d380c8b7 on hv-cinder-80152 Oct 14 03:14:29.249135 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-840f7c14-7b2a-4d6e-9164-d5033d140abc req-b095b2bd-b40f-4127-957d-d8ac22183946 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032670 Oct 14 03:14:29.249774 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 484/980] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:29.466281 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3e0c9cc0-9976-458d-9466-7f94c19673a9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:29.467665 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3e0c9cc0-9976-458d-9466-7f94c19673a9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:29.475344 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3e0c9cc0-9976-458d-9466-7f94c19673a9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:29.475826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3e0c9cc0-9976-458d-9466-7f94c19673a9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:29.476463 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3e0c9cc0-9976-458d-9466-7f94c19673a9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:29.477502 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3e0c9cc0-9976-458d-9466-7f94c19673a9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:29.478122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3e0c9cc0-9976-458d-9466-7f94c19673a9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:29.480653 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3e0c9cc0-9976-458d-9466-7f94c19673a9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:29.646578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3e0c9cc0-9976-458d-9466-7f94c19673a9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:29.657308 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3e0c9cc0-9976-458d-9466-7f94c19673a9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1261 microversion: 2.1 time: 0.195347 Oct 14 03:14:29.657891 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 497/981] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:29 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1261 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:30.683687 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-a27ccc3b-3f95-48ba-a783-b7a302fd4be6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:30.684410 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-a27ccc3b-3f95-48ba-a783-b7a302fd4be6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:30.690681 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a27ccc3b-3f95-48ba-a783-b7a302fd4be6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:30.691177 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a27ccc3b-3f95-48ba-a783-b7a302fd4be6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:30.691632 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a27ccc3b-3f95-48ba-a783-b7a302fd4be6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:30.693609 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a27ccc3b-3f95-48ba-a783-b7a302fd4be6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:30.693609 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a27ccc3b-3f95-48ba-a783-b7a302fd4be6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:30.693860 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-a27ccc3b-3f95-48ba-a783-b7a302fd4be6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:30.826062 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-a27ccc3b-3f95-48ba-a783-b7a302fd4be6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:30.833879 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-a27ccc3b-3f95-48ba-a783-b7a302fd4be6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1261 microversion: 2.1 time: 0.155557 Oct 14 03:14:30.834962 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 485/982] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:30 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:31.863735 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-990891b6-4940-4f18-a845-2d6df1acb58b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:31.864899 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-990891b6-4940-4f18-a845-2d6df1acb58b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:31.867456 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:31.876900 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-990891b6-4940-4f18-a845-2d6df1acb58b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:31.877704 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-990891b6-4940-4f18-a845-2d6df1acb58b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:31.878304 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-990891b6-4940-4f18-a845-2d6df1acb58b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:31.879200 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-990891b6-4940-4f18-a845-2d6df1acb58b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:31.879862 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-990891b6-4940-4f18-a845-2d6df1acb58b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:31.880278 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-990891b6-4940-4f18-a845-2d6df1acb58b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:32.025543 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-990891b6-4940-4f18-a845-2d6df1acb58b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:32.044153 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-990891b6-4940-4f18-a845-2d6df1acb58b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1445 microversion: 2.1 time: 0.184332 Oct 14 03:14:32.045061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 498/983] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:31 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1445 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:32.071036 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-4ceecf47-da1a-41dd-a60c-805458a71fee tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:32.072429 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-4ceecf47-da1a-41dd-a60c-805458a71fee tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:32.076427 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:32.080685 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4ceecf47-da1a-41dd-a60c-805458a71fee tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:32.081230 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4ceecf47-da1a-41dd-a60c-805458a71fee tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:32.082129 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4ceecf47-da1a-41dd-a60c-805458a71fee tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:32.082833 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4ceecf47-da1a-41dd-a60c-805458a71fee tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:32.083265 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4ceecf47-da1a-41dd-a60c-805458a71fee tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:32.083701 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4ceecf47-da1a-41dd-a60c-805458a71fee tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:32.230073 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4ceecf47-da1a-41dd-a60c-805458a71fee tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:32.237960 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-4ceecf47-da1a-41dd-a60c-805458a71fee tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1445 microversion: 2.1 time: 0.171078 Oct 14 03:14:32.238540 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 486/984] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:32 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1445 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:34.693732 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-de2fadde-6db7-4dae-ae8d-fc3f1a4be1bf req-29be8551-e979-4758-a29f-d4bdc4625f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c2c238c-787c-4bb0-b123-61e7d380c8b7", "tag": "49070fc8-b204-45c9-b9e0-f8e67c3fa614"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:14:34.704054 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-de2fadde-6db7-4dae-ae8d-fc3f1a4be1bf req-29be8551-e979-4758-a29f-d4bdc4625f60 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:34.704584 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-de2fadde-6db7-4dae-ae8d-fc3f1a4be1bf req-29be8551-e979-4758-a29f-d4bdc4625f60 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:34.705316 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-de2fadde-6db7-4dae-ae8d-fc3f1a4be1bf req-29be8551-e979-4758-a29f-d4bdc4625f60 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:34.717597 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-de2fadde-6db7-4dae-ae8d-fc3f1a4be1bf req-29be8551-e979-4758-a29f-d4bdc4625f60 service nova] Creating event network-changed:49070fc8-b204-45c9-b9e0-f8e67c3fa614 for instance 9c2c238c-787c-4bb0-b123-61e7d380c8b7 on hv-cinder-80152 Oct 14 03:14:34.722670 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-de2fadde-6db7-4dae-ae8d-fc3f1a4be1bf req-29be8551-e979-4758-a29f-d4bdc4625f60 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164751 Oct 14 03:14:34.723265 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 499/985] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:15:00.072678 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-de98b391-0c82-4252-83ae-ef54df1f138a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:00.074944 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-de98b391-0c82-4252-83ae-ef54df1f138a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:00.077764 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=86 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:00.083324 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-de98b391-0c82-4252-83ae-ef54df1f138a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:00.085587 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-de98b391-0c82-4252-83ae-ef54df1f138a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:00.086220 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-de98b391-0c82-4252-83ae-ef54df1f138a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:00.087100 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-de98b391-0c82-4252-83ae-ef54df1f138a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:00.087714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-de98b391-0c82-4252-83ae-ef54df1f138a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:00.088296 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-de98b391-0c82-4252-83ae-ef54df1f138a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:00.122510 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-de98b391-0c82-4252-83ae-ef54df1f138a tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054665 Oct 14 03:15:00.123087 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 487/986] 10.222.0.13 () {60 vars in 1343 bytes} [Fri Oct 14 03:15:00 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:15:00.186504 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 14 03:15:00.187051 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Fri Oct 14 03:15:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 (ip 10.222.0.13) !!! Oct 14 03:15:00.187797 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=3 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:00.188577 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=70 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:00.192628 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f7ac7e43-9d92-42e1-84d1-c26e1fcf90de tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:00.193214 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f7ac7e43-9d92-42e1-84d1-c26e1fcf90de tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:00.203486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f7ac7e43-9d92-42e1-84d1-c26e1fcf90de tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:00.204285 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f7ac7e43-9d92-42e1-84d1-c26e1fcf90de tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:00.204485 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f7ac7e43-9d92-42e1-84d1-c26e1fcf90de tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:00.205116 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f7ac7e43-9d92-42e1-84d1-c26e1fcf90de tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:00.205570 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f7ac7e43-9d92-42e1-84d1-c26e1fcf90de tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:00.205993 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f7ac7e43-9d92-42e1-84d1-c26e1fcf90de tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:00.235427 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f7ac7e43-9d92-42e1-84d1-c26e1fcf90de tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Going to try to terminate instance {{(pid=119301) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:15:00.559023 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f7ac7e43-9d92-42e1-84d1-c26e1fcf90de tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 204 len: 0 microversion: 2.20 time: 0.374054 Oct 14 03:15:00.559617 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 500/987] 10.222.0.13 () {60 vars in 1280 bytes} [Fri Oct 14 03:15:00 2022] DELETE /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 14 03:15:00.568632 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e17c5883-62fb-4625-87c8-1b254dd83a07 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:00.569292 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e17c5883-62fb-4625-87c8-1b254dd83a07 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:00.576091 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e17c5883-62fb-4625-87c8-1b254dd83a07 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:00.576609 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e17c5883-62fb-4625-87c8-1b254dd83a07 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:00.577048 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e17c5883-62fb-4625-87c8-1b254dd83a07 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:00.577738 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e17c5883-62fb-4625-87c8-1b254dd83a07 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:00.578193 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e17c5883-62fb-4625-87c8-1b254dd83a07 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:00.578624 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e17c5883-62fb-4625-87c8-1b254dd83a07 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:00.708141 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e17c5883-62fb-4625-87c8-1b254dd83a07 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:00.716219 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e17c5883-62fb-4625-87c8-1b254dd83a07 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:00.717709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e17c5883-62fb-4625-87c8-1b254dd83a07 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:00.718871 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e17c5883-62fb-4625-87c8-1b254dd83a07 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.154907 Oct 14 03:15:00.719434 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 488/988] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:00 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:15:01.745268 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1434547f-587a-4a15-a2fe-d4c246a08ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:01.745966 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1434547f-587a-4a15-a2fe-d4c246a08ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:01.752235 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1434547f-587a-4a15-a2fe-d4c246a08ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:01.752749 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1434547f-587a-4a15-a2fe-d4c246a08ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:01.753183 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1434547f-587a-4a15-a2fe-d4c246a08ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:01.753874 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1434547f-587a-4a15-a2fe-d4c246a08ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:01.754326 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1434547f-587a-4a15-a2fe-d4c246a08ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:01.754750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1434547f-587a-4a15-a2fe-d4c246a08ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:01.887501 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1434547f-587a-4a15-a2fe-d4c246a08ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:01.897919 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1434547f-587a-4a15-a2fe-d4c246a08ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:01.897919 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1434547f-587a-4a15-a2fe-d4c246a08ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:01.898831 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1434547f-587a-4a15-a2fe-d4c246a08ff4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1724 microversion: 2.20 time: 0.158358 Oct 14 03:15:01.899417 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 501/989] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:01 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:15:02.925005 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e59099d0-ee7c-471d-9782-f1b92a01be9f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:02.925777 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e59099d0-ee7c-471d-9782-f1b92a01be9f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:02.932808 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e59099d0-ee7c-471d-9782-f1b92a01be9f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:02.933306 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e59099d0-ee7c-471d-9782-f1b92a01be9f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:02.933776 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e59099d0-ee7c-471d-9782-f1b92a01be9f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:02.934473 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e59099d0-ee7c-471d-9782-f1b92a01be9f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:02.935717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e59099d0-ee7c-471d-9782-f1b92a01be9f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:02.936153 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e59099d0-ee7c-471d-9782-f1b92a01be9f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:02.994057 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-bb2d95d5-76b0-43f3-8569-b47d530a2d7d req-6d8fbec9-73ff-44fb-8c14-a810862e8f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c6bac7-dcd5-4fd2-b81d-682898442716", "name": "network-vif-deleted", "tag": "a0776357-4e9e-4296-84d0-654e4b00c042"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:15:03.004749 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-bb2d95d5-76b0-43f3-8569-b47d530a2d7d req-6d8fbec9-73ff-44fb-8c14-a810862e8f97 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:03.006842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-bb2d95d5-76b0-43f3-8569-b47d530a2d7d req-6d8fbec9-73ff-44fb-8c14-a810862e8f97 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:03.006842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-bb2d95d5-76b0-43f3-8569-b47d530a2d7d req-6d8fbec9-73ff-44fb-8c14-a810862e8f97 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:03.015356 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e59099d0-ee7c-471d-9782-f1b92a01be9f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:03.017882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-bb2d95d5-76b0-43f3-8569-b47d530a2d7d req-6d8fbec9-73ff-44fb-8c14-a810862e8f97 service nova] Creating event network-vif-deleted:a0776357-4e9e-4296-84d0-654e4b00c042 for instance b7c6bac7-dcd5-4fd2-b81d-682898442716 on hv-cinder-80152 Oct 14 03:15:03.022770 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-bb2d95d5-76b0-43f3-8569-b47d530a2d7d req-6d8fbec9-73ff-44fb-8c14-a810862e8f97 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032837 Oct 14 03:15:03.024191 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 502/990] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:15:03.026147 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e59099d0-ee7c-471d-9782-f1b92a01be9f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:03.027420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e59099d0-ee7c-471d-9782-f1b92a01be9f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:03.028882 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e59099d0-ee7c-471d-9782-f1b92a01be9f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1657 microversion: 2.20 time: 0.108109 Oct 14 03:15:03.029471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 489/991] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:02 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1657 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:15:04.056347 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:04.057052 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:04.063192 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:04.063681 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:04.064120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:04.064886 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:04.065351 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:04.065779 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:04.100009 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:04.100533 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:04.101001 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:04.101951 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lazy-loading 'fault' on Instance uuid b7c6bac7-dcd5-4fd2-b81d-682898442716 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:15:04.146010 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:04.153020 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:04.154474 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1201fb5f14154b048f5c55bd566e91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28c1645ea1f4941ab2d016ad313ae6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:04.155905 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-09dc0644-e466-4661-81b2-f070ca82bc94 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 200 len: 1372 microversion: 2.20 time: 0.105094 Oct 14 03:15:04.156476 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 503/992] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:04 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:15:05.190323 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-047b3187-d62f-4dc9-b7dc-ed8a41e68ed4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:05.190323 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-047b3187-d62f-4dc9-b7dc-ed8a41e68ed4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:05.193919 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-047b3187-d62f-4dc9-b7dc-ed8a41e68ed4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:05.194403 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-047b3187-d62f-4dc9-b7dc-ed8a41e68ed4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:05.194839 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-047b3187-d62f-4dc9-b7dc-ed8a41e68ed4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:05.195534 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-047b3187-d62f-4dc9-b7dc-ed8a41e68ed4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:05.196032 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-047b3187-d62f-4dc9-b7dc-ed8a41e68ed4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:05.196488 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-047b3187-d62f-4dc9-b7dc-ed8a41e68ed4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:05.209892 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-047b3187-d62f-4dc9-b7dc-ed8a41e68ed4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] HTTP exception thrown: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-047b3187-d62f-4dc9-b7dc-ed8a41e68ed4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Request method failure captured: Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 HTTP/1.1 Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKGCNYzUgY2W8ABGT17ZnZvUXr0wici_uC4FJd-MZKpAS6f8L6OQDWgZtxoVvYLblGrHLtin0R79yVHG9pQtD0u8dZkneMphiaS-s8IkENpBChNMMKCwbd4js56Y7LD3a0sEr57uhMse-JioqbN7ibvoxPFQEbd1Mnu09Yz453h-2Q Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: b28c1645ea1f4941ab2d016ad313ae6b Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:15:05.212072 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:15:05.213951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:15:05.213951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:05.213951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: b28c1645ea1f4941ab2d016ad313ae6b Oct 14 03:15:05.213951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:05.213951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-AttachVolumeShelveTestJSON-786375232-project Oct 14 03:15:05.213951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:15:05.213951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:15:05.213951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 1201fb5f14154b048f5c55bd566e91b9 Oct 14 03:15:05.213951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-AttachVolumeShelveTestJSON-786375232-project Oct 14 03:15:05.213951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:15:05.213951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:05.213951 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': 'b7c6bac7-dcd5-4fd2-b81d-682898442716'} Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:15:05.214996 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:05.216633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:05.218254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-047b3187-d62f-4dc9-b7dc-ed8a41e68ed4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Returning 404 to user: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:15:05.218254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-047b3187-d62f-4dc9-b7dc-ed8a41e68ed4 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 404 len: 111 microversion: 2.20 time: 0.030388 Oct 14 03:15:05.218254 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 490/993] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:05 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:15:05.223986 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9c1b151e-af21-4009-9087-a9143612879b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '.version_select at 0x7fdcc750ed30>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:05.314867 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9c1b151e-af21-4009-9087-a9143612879b tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1233331511" status: 204 len: 0 microversion: 2.20 time: 0.095077 Oct 14 03:15:05.315446 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 504/994] 10.222.0.13 () {60 vars in 1262 bytes} [Fri Oct 14 03:15:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1233331511 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 14 03:15:07.635160 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-60453130-cdfe-44bb-8f7f-aeabaacbf27f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:07.635661 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-60453130-cdfe-44bb-8f7f-aeabaacbf27f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:07.642519 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-60453130-cdfe-44bb-8f7f-aeabaacbf27f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:07.643001 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-60453130-cdfe-44bb-8f7f-aeabaacbf27f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:07.645911 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-60453130-cdfe-44bb-8f7f-aeabaacbf27f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:07.645911 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-60453130-cdfe-44bb-8f7f-aeabaacbf27f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:07.645911 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-60453130-cdfe-44bb-8f7f-aeabaacbf27f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:07.645911 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-60453130-cdfe-44bb-8f7f-aeabaacbf27f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:07.660786 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-60453130-cdfe-44bb-8f7f-aeabaacbf27f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] HTTP exception thrown: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-60453130-cdfe-44bb-8f7f-aeabaacbf27f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Request method failure captured: Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: DELETE /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 HTTP/1.1 Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKGCNYzUgY2W8ABGT17ZnZvUXr0wici_uC4FJd-MZKpAS6f8L6OQDWgZtxoVvYLblGrHLtin0R79yVHG9pQtD0u8dZkneMphiaS-s8IkENpBChNMMKCwbd4js56Y7LD3a0sEr57uhMse-JioqbN7ibvoxPFQEbd1Mnu09Yz453h-2Q Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: b28c1645ea1f4941ab2d016ad313ae6b Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:15:07.662437 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:15:07.664270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:15:07.664270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:07.664270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: b28c1645ea1f4941ab2d016ad313ae6b Oct 14 03:15:07.664270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:07.664270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-AttachVolumeShelveTestJSON-786375232-project Oct 14 03:15:07.664270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:15:07.664270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:15:07.664270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 1201fb5f14154b048f5c55bd566e91b9 Oct 14 03:15:07.664270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-AttachVolumeShelveTestJSON-786375232-project Oct 14 03:15:07.664270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:15:07.664270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:07.664270 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': 'b7c6bac7-dcd5-4fd2-b81d-682898442716'} Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:15:07.669709 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:07.671130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.672428 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-60453130-cdfe-44bb-8f7f-aeabaacbf27f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Returning 404 to user: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:15:07.672428 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-60453130-cdfe-44bb-8f7f-aeabaacbf27f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 404 len: 111 microversion: 2.20 time: 0.034780 Oct 14 03:15:07.672428 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 491/995] 10.222.0.13 () {60 vars in 1280 bytes} [Fri Oct 14 03:15:07 2022] DELETE /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:15:07.674470 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-da5a043c-535c-4d6a-942d-c36f939c9e8f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:07.675186 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-da5a043c-535c-4d6a-942d-c36f939c9e8f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: b7c6bac7-dcd5-4fd2-b81d-682898442716] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:07.682048 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-da5a043c-535c-4d6a-942d-c36f939c9e8f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:07.682506 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-da5a043c-535c-4d6a-942d-c36f939c9e8f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:07.682944 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-da5a043c-535c-4d6a-942d-c36f939c9e8f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:07.683663 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-da5a043c-535c-4d6a-942d-c36f939c9e8f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:07.684111 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-da5a043c-535c-4d6a-942d-c36f939c9e8f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:07.684560 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-da5a043c-535c-4d6a-942d-c36f939c9e8f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:07.698208 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-da5a043c-535c-4d6a-942d-c36f939c9e8f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] HTTP exception thrown: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-da5a043c-535c-4d6a-942d-c36f939c9e8f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Request method failure captured: Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 HTTP/1.1 Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNKGCNYzUgY2W8ABGT17ZnZvUXr0wici_uC4FJd-MZKpAS6f8L6OQDWgZtxoVvYLblGrHLtin0R79yVHG9pQtD0u8dZkneMphiaS-s8IkENpBChNMMKCwbd4js56Y7LD3a0sEr57uhMse-JioqbN7ibvoxPFQEbd1Mnu09Yz453h-2Q Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: b28c1645ea1f4941ab2d016ad313ae6b Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:15:07.703971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:15:07.705657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:15:07.705657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:07.705657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: b28c1645ea1f4941ab2d016ad313ae6b Oct 14 03:15:07.705657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:07.705657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-AttachVolumeShelveTestJSON-786375232-project Oct 14 03:15:07.705657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:15:07.705657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:15:07.705657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 1201fb5f14154b048f5c55bd566e91b9 Oct 14 03:15:07.705657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-AttachVolumeShelveTestJSON-786375232-project Oct 14 03:15:07.705657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:15:07.705657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:07.705657 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': 'b7c6bac7-dcd5-4fd2-b81d-682898442716'} Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:15:07.706585 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. Oct 14 03:15:07.708122 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.709598 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-da5a043c-535c-4d6a-942d-c36f939c9e8f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Returning 404 to user: Instance b7c6bac7-dcd5-4fd2-b81d-682898442716 could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:15:07.709598 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-da5a043c-535c-4d6a-942d-c36f939c9e8f tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716" status: 404 len: 111 microversion: 2.20 time: 0.031342 Oct 14 03:15:07.709598 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 505/996] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:07 2022] GET /compute/v2.1/servers/b7c6bac7-dcd5-4fd2-b81d-682898442716 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:15:08.984783 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e7ada14d-01ec-4818-a29d-fdd6b0391888 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:08.985348 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e7ada14d-01ec-4818-a29d-fdd6b0391888 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:08.992848 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7ada14d-01ec-4818-a29d-fdd6b0391888 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:08.993410 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7ada14d-01ec-4818-a29d-fdd6b0391888 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:08.994478 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7ada14d-01ec-4818-a29d-fdd6b0391888 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:08.995559 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7ada14d-01ec-4818-a29d-fdd6b0391888 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:08.996081 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7ada14d-01ec-4818-a29d-fdd6b0391888 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:08.996604 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e7ada14d-01ec-4818-a29d-fdd6b0391888 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:09.013116 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-e7ada14d-01ec-4818-a29d-fdd6b0391888 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] HTTP exception thrown: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e7ada14d-01ec-4818-a29d-fdd6b0391888 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Request method failure captured: Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: DELETE /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d HTTP/1.1 Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNKGCNYzUgY2W8ABGT17ZnZvUXr0wici_uC4FJd-MZKpAS6f8L6OQDWgZtxoVvYLblGrHLtin0R79yVHG9pQtD0u8dZkneMphiaS-s8IkENpBChNMMKCwbd4js56Y7LD3a0sEr57uhMse-JioqbN7ibvoxPFQEbd1Mnu09Yz453h-2Q Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: b28c1645ea1f4941ab2d016ad313ae6b Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:15:09.014943 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:15:09.016811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:15:09.016811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:09.016811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: b28c1645ea1f4941ab2d016ad313ae6b Oct 14 03:15:09.016811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:09.016811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-AttachVolumeShelveTestJSON-786375232-project Oct 14 03:15:09.016811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:15:09.016811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:15:09.016811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 1201fb5f14154b048f5c55bd566e91b9 Oct 14 03:15:09.016811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-AttachVolumeShelveTestJSON-786375232-project Oct 14 03:15:09.016811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:15:09.016811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:15:09.016811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': '866d9750-81fa-4eba-a3b7-b1c1182ed24d'} Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:15:09.017744 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:15:09.019288 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:15:09.021325 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e7ada14d-01ec-4818-a29d-fdd6b0391888 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Returning 404 to user: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:15:09.021325 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e7ada14d-01ec-4818-a29d-fdd6b0391888 tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "DELETE /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 404 len: 111 microversion: 2.20 time: 0.035863 Oct 14 03:15:09.021325 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 492/997] 10.222.0.13 () {60 vars in 1280 bytes} [Fri Oct 14 03:15:08 2022] DELETE /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:15:09.025269 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e207bdc1-9640-4fe9-8837-2b55f0e586eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:09.025889 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e207bdc1-9640-4fe9-8837-2b55f0e586eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] [instance: 866d9750-81fa-4eba-a3b7-b1c1182ed24d] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:09.032540 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e207bdc1-9640-4fe9-8837-2b55f0e586eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:09.033026 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e207bdc1-9640-4fe9-8837-2b55f0e586eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:09.033483 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e207bdc1-9640-4fe9-8837-2b55f0e586eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:09.034167 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e207bdc1-9640-4fe9-8837-2b55f0e586eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:09.034627 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e207bdc1-9640-4fe9-8837-2b55f0e586eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:09.035055 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e207bdc1-9640-4fe9-8837-2b55f0e586eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-e207bdc1-9640-4fe9-8837-2b55f0e586eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] HTTP exception thrown: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e207bdc1-9640-4fe9-8837-2b55f0e586eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Request method failure captured: Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d HTTP/1.1 Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNKGCNYzUgY2W8ABGT17ZnZvUXr0wici_uC4FJd-MZKpAS6f8L6OQDWgZtxoVvYLblGrHLtin0R79yVHG9pQtD0u8dZkneMphiaS-s8IkENpBChNMMKCwbd4js56Y7LD3a0sEr57uhMse-JioqbN7ibvoxPFQEbd1Mnu09Yz453h-2Q Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: b28c1645ea1f4941ab2d016ad313ae6b Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:15:09.050449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:15:09.052286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b28c1645ea1f4941ab2d016ad313ae6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:15:09.052286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:09.052286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: b28c1645ea1f4941ab2d016ad313ae6b Oct 14 03:15:09.052286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-786375232 Oct 14 03:15:09.052286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-AttachVolumeShelveTestJSON-786375232-project Oct 14 03:15:09.052286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:15:09.052286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:15:09.052286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 1201fb5f14154b048f5c55bd566e91b9 Oct 14 03:15:09.052286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-AttachVolumeShelveTestJSON-786375232-project Oct 14 03:15:09.052286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:15:09.052286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:15:09.052286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '866d9750-81fa-4eba-a3b7-b1c1182ed24d'} Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:15:09.053103 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. Oct 14 03:15:09.054413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:09.055581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e207bdc1-9640-4fe9-8837-2b55f0e586eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] Returning 404 to user: Instance 866d9750-81fa-4eba-a3b7-b1c1182ed24d could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:15:09.055581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e207bdc1-9640-4fe9-8837-2b55f0e586eb tempest-AttachVolumeShelveTestJSON-786375232 tempest-AttachVolumeShelveTestJSON-786375232-project] 10.222.0.13 "GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d" status: 404 len: 111 microversion: 2.20 time: 0.030208 Oct 14 03:15:09.055581 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 506/998] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:09 2022] GET /compute/v2.1/servers/866d9750-81fa-4eba-a3b7-b1c1182ed24d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:15:09.960250 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-605118052", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452"}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:15:10.012276 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.network.neutron [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] validate_networks() for None {{(pid=119302) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:15:10.407129 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Flavor limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:15:10.407682 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Image limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:15:10.408158 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Flavor pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:15:10.408594 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Image pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:15:10.409007 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:15:10.417562 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:10.418039 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:10.418473 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:10.419218 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:10.419672 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:10.420095 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:10.437195 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Getting quotas for project 6117dd60941f4804899175ecf89aefa4. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:15:10.441051 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Getting quotas for user 20ecd6112f824d4eafb2f51518b5e873 and project 6117dd60941f4804899175ecf89aefa4. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:15:10.452265 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Going to run 1 instances... {{(pid=119302) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:15:10.454601 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:15:10.593710 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-68b40c2d-5e44-4e67-af36-987e68627d9a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637309 Oct 14 03:15:10.595251 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 493/999] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:15:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:15:10.606826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-5d089190-328c-40ec-8752-0abc82334325 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:10.608147 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-5d089190-328c-40ec-8752-0abc82334325 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:10.684539 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-5d089190-328c-40ec-8752-0abc82334325 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:10.696443 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-5d089190-328c-40ec-8752-0abc82334325 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1214 microversion: 2.1 time: 0.093951 Oct 14 03:15:10.697793 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 507/1000] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:10 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:15:11.722168 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-c8775195-f9e4-4910-9263-cb14cf70f699 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:11.722789 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-c8775195-f9e4-4910-9263-cb14cf70f699 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:11.782725 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-c8775195-f9e4-4910-9263-cb14cf70f699 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:11.790497 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-c8775195-f9e4-4910-9263-cb14cf70f699 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1214 microversion: 2.1 time: 0.072674 Oct 14 03:15:11.791374 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 494/1001] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:11 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:15:12.816017 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a3b3ccae-de2b-44b9-bb03-21fa53c2a569 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:12.816955 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a3b3ccae-de2b-44b9-bb03-21fa53c2a569 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:12.832525 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a3b3ccae-de2b-44b9-bb03-21fa53c2a569 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:12.833319 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a3b3ccae-de2b-44b9-bb03-21fa53c2a569 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:12.834241 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a3b3ccae-de2b-44b9-bb03-21fa53c2a569 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:12.838611 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a3b3ccae-de2b-44b9-bb03-21fa53c2a569 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:12.843334 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a3b3ccae-de2b-44b9-bb03-21fa53c2a569 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:12.845448 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a3b3ccae-de2b-44b9-bb03-21fa53c2a569 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:12.971316 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a3b3ccae-de2b-44b9-bb03-21fa53c2a569 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:12.979237 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a3b3ccae-de2b-44b9-bb03-21fa53c2a569 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1266 microversion: 2.1 time: 0.169697 Oct 14 03:15:12.979815 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 508/1002] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:12 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:15:14.003661 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-6c85cc5e-ba88-484d-959c-da4ce20750a0 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:14.004159 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-6c85cc5e-ba88-484d-959c-da4ce20750a0 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:14.011184 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c85cc5e-ba88-484d-959c-da4ce20750a0 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:14.011614 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c85cc5e-ba88-484d-959c-da4ce20750a0 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:14.012059 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c85cc5e-ba88-484d-959c-da4ce20750a0 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:14.012797 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c85cc5e-ba88-484d-959c-da4ce20750a0 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:14.013260 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c85cc5e-ba88-484d-959c-da4ce20750a0 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:14.013691 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-6c85cc5e-ba88-484d-959c-da4ce20750a0 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:14.083799 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-6c85cc5e-ba88-484d-959c-da4ce20750a0 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:14.091822 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-6c85cc5e-ba88-484d-959c-da4ce20750a0 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1272 microversion: 2.1 time: 0.092385 Oct 14 03:15:14.092413 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 495/1003] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:13 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:15:15.114640 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ea617fdd-463b-4c3e-8bb4-b7cdf9c185e1 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:15.115806 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ea617fdd-463b-4c3e-8bb4-b7cdf9c185e1 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:15.123445 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea617fdd-463b-4c3e-8bb4-b7cdf9c185e1 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:15.124118 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea617fdd-463b-4c3e-8bb4-b7cdf9c185e1 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:15.124596 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea617fdd-463b-4c3e-8bb4-b7cdf9c185e1 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:15.125311 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea617fdd-463b-4c3e-8bb4-b7cdf9c185e1 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:15.125773 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea617fdd-463b-4c3e-8bb4-b7cdf9c185e1 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:15.126206 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ea617fdd-463b-4c3e-8bb4-b7cdf9c185e1 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:15.257572 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ea617fdd-463b-4c3e-8bb4-b7cdf9c185e1 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:15.265235 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ea617fdd-463b-4c3e-8bb4-b7cdf9c185e1 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1314 microversion: 2.1 time: 0.154893 Oct 14 03:15:15.265819 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 509/1004] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:15 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:15:15.676691 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-6055ff50-38f7-4877-b193-624eecb137ee req-5fb70b49-55e8-4f72-b82b-0bffb6a8f232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae", "tag": "823f51c5-d93f-47a6-b4f4-68a38288acd6"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:15:15.689490 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-6055ff50-38f7-4877-b193-624eecb137ee req-5fb70b49-55e8-4f72-b82b-0bffb6a8f232 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:15.689979 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-6055ff50-38f7-4877-b193-624eecb137ee req-5fb70b49-55e8-4f72-b82b-0bffb6a8f232 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:15.690633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-6055ff50-38f7-4877-b193-624eecb137ee req-5fb70b49-55e8-4f72-b82b-0bffb6a8f232 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:15.703205 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-6055ff50-38f7-4877-b193-624eecb137ee req-5fb70b49-55e8-4f72-b82b-0bffb6a8f232 service nova] Creating event network-changed:823f51c5-d93f-47a6-b4f4-68a38288acd6 for instance 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae on hv-cinder-80152 Oct 14 03:15:15.711121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-6055ff50-38f7-4877-b193-624eecb137ee req-5fb70b49-55e8-4f72-b82b-0bffb6a8f232 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036037 Oct 14 03:15:15.711121 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 496/1005] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:15:16.290545 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-997ee826-08a0-4af0-b784-97902efd64d9 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:16.291172 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-997ee826-08a0-4af0-b784-97902efd64d9 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:16.302595 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-997ee826-08a0-4af0-b784-97902efd64d9 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:16.303199 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-997ee826-08a0-4af0-b784-97902efd64d9 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:16.303984 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-997ee826-08a0-4af0-b784-97902efd64d9 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:16.305673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-997ee826-08a0-4af0-b784-97902efd64d9 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:16.306488 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-997ee826-08a0-4af0-b784-97902efd64d9 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:16.307035 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-997ee826-08a0-4af0-b784-97902efd64d9 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:16.477516 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-997ee826-08a0-4af0-b784-97902efd64d9 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:16.485956 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-997ee826-08a0-4af0-b784-97902efd64d9 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1314 microversion: 2.1 time: 0.202419 Oct 14 03:15:16.486539 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 510/1006] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:16 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:15:17.514411 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-91325818-dff5-4433-a040-f00fc9445010 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:17.515053 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-91325818-dff5-4433-a040-f00fc9445010 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:17.521388 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-91325818-dff5-4433-a040-f00fc9445010 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:17.521886 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-91325818-dff5-4433-a040-f00fc9445010 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:17.522333 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-91325818-dff5-4433-a040-f00fc9445010 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:17.523071 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-91325818-dff5-4433-a040-f00fc9445010 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:17.523717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-91325818-dff5-4433-a040-f00fc9445010 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:17.524316 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-91325818-dff5-4433-a040-f00fc9445010 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:17.672415 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-91325818-dff5-4433-a040-f00fc9445010 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:17.678159 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-91325818-dff5-4433-a040-f00fc9445010 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1314 microversion: 2.1 time: 0.172780 Oct 14 03:15:17.678724 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 497/1007] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:17 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:15:18.702182 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f5672120-0f63-4aba-819e-efdfc6f5449d tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:18.702743 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f5672120-0f63-4aba-819e-efdfc6f5449d tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:18.709155 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5672120-0f63-4aba-819e-efdfc6f5449d tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:18.709652 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5672120-0f63-4aba-819e-efdfc6f5449d tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:18.710098 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5672120-0f63-4aba-819e-efdfc6f5449d tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:18.710815 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5672120-0f63-4aba-819e-efdfc6f5449d tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:18.711279 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5672120-0f63-4aba-819e-efdfc6f5449d tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:18.711710 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f5672120-0f63-4aba-819e-efdfc6f5449d tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:18.850373 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f5672120-0f63-4aba-819e-efdfc6f5449d tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:18.858518 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f5672120-0f63-4aba-819e-efdfc6f5449d tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1314 microversion: 2.1 time: 0.160598 Oct 14 03:15:18.859748 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 511/1008] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:18 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:15:19.881358 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-549c38c7-4c20-47ea-b5fc-b93d08b74fed tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:19.882055 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-549c38c7-4c20-47ea-b5fc-b93d08b74fed tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:19.890275 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-549c38c7-4c20-47ea-b5fc-b93d08b74fed tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:19.890952 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-549c38c7-4c20-47ea-b5fc-b93d08b74fed tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:19.891394 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-549c38c7-4c20-47ea-b5fc-b93d08b74fed tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:19.892133 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-549c38c7-4c20-47ea-b5fc-b93d08b74fed tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:19.892811 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-549c38c7-4c20-47ea-b5fc-b93d08b74fed tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:19.893239 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-549c38c7-4c20-47ea-b5fc-b93d08b74fed tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:20.066931 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-549c38c7-4c20-47ea-b5fc-b93d08b74fed tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:20.074743 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-549c38c7-4c20-47ea-b5fc-b93d08b74fed tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1314 microversion: 2.1 time: 0.197397 Oct 14 03:15:20.075309 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 498/1009] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:19 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:15:21.098345 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8c036502-a8b8-4e8e-8c48-291230baae18 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:21.098962 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8c036502-a8b8-4e8e-8c48-291230baae18 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:21.101552 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=2 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:21.106956 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8c036502-a8b8-4e8e-8c48-291230baae18 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:21.107447 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8c036502-a8b8-4e8e-8c48-291230baae18 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:21.108181 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8c036502-a8b8-4e8e-8c48-291230baae18 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:21.108929 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8c036502-a8b8-4e8e-8c48-291230baae18 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:21.109390 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8c036502-a8b8-4e8e-8c48-291230baae18 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:21.109821 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8c036502-a8b8-4e8e-8c48-291230baae18 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:21.279824 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-8c036502-a8b8-4e8e-8c48-291230baae18 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:21.287882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8c036502-a8b8-4e8e-8c48-291230baae18 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1314 microversion: 2.1 time: 0.193817 Oct 14 03:15:21.288798 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 512/1010] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:21 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:15:21.449833 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-5d177330-34c3-4bb6-8785-cede6815e8b9 req-e468b42b-6618-4ebd-8855-df57a7e8e5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae", "name": "network-vif-plugged", "status": "completed", "tag": "823f51c5-d93f-47a6-b4f4-68a38288acd6"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:15:21.460650 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=2 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:21.466900 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-5d177330-34c3-4bb6-8785-cede6815e8b9 req-e468b42b-6618-4ebd-8855-df57a7e8e5d7 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:21.467471 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-5d177330-34c3-4bb6-8785-cede6815e8b9 req-e468b42b-6618-4ebd-8855-df57a7e8e5d7 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:21.468142 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-5d177330-34c3-4bb6-8785-cede6815e8b9 req-e468b42b-6618-4ebd-8855-df57a7e8e5d7 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:21.483550 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-5d177330-34c3-4bb6-8785-cede6815e8b9 req-e468b42b-6618-4ebd-8855-df57a7e8e5d7 service nova] Creating event network-vif-plugged:823f51c5-d93f-47a6-b4f4-68a38288acd6 for instance 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae on hv-cinder-80152 Oct 14 03:15:21.490456 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-5d177330-34c3-4bb6-8785-cede6815e8b9 req-e468b42b-6618-4ebd-8855-df57a7e8e5d7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045135 Oct 14 03:15:21.491092 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 499/1011] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:15:22.314672 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-32dcc4ce-7f39-48da-85a6-12c3e2a3c8c2 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:22.314672 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-32dcc4ce-7f39-48da-85a6-12c3e2a3c8c2 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:22.318488 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-32dcc4ce-7f39-48da-85a6-12c3e2a3c8c2 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:22.318967 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-32dcc4ce-7f39-48da-85a6-12c3e2a3c8c2 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:22.319490 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-32dcc4ce-7f39-48da-85a6-12c3e2a3c8c2 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:22.320286 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-32dcc4ce-7f39-48da-85a6-12c3e2a3c8c2 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:22.320850 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-32dcc4ce-7f39-48da-85a6-12c3e2a3c8c2 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:22.324855 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-32dcc4ce-7f39-48da-85a6-12c3e2a3c8c2 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:22.462666 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-32dcc4ce-7f39-48da-85a6-12c3e2a3c8c2 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:22.471459 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-32dcc4ce-7f39-48da-85a6-12c3e2a3c8c2 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1314 microversion: 2.1 time: 0.164526 Oct 14 03:15:22.472046 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 513/1012] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:22 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:15:23.497227 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b88f1398-993b-45a2-b7f5-facb458aa1c3 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:23.507336 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b88f1398-993b-45a2-b7f5-facb458aa1c3 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:23.507336 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=8 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:23.507336 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b88f1398-993b-45a2-b7f5-facb458aa1c3 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:23.507336 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b88f1398-993b-45a2-b7f5-facb458aa1c3 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:23.507336 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b88f1398-993b-45a2-b7f5-facb458aa1c3 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:23.508642 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b88f1398-993b-45a2-b7f5-facb458aa1c3 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:23.509113 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b88f1398-993b-45a2-b7f5-facb458aa1c3 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:23.509544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b88f1398-993b-45a2-b7f5-facb458aa1c3 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:23.661478 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b88f1398-993b-45a2-b7f5-facb458aa1c3 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:23.669871 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b88f1398-993b-45a2-b7f5-facb458aa1c3 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1314 microversion: 2.1 time: 0.178947 Oct 14 03:15:23.670508 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 500/1013] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:23 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:15:24.692733 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1b60efe5-7372-4e99-ad8b-c741b154e191 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:24.693435 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1b60efe5-7372-4e99-ad8b-c741b154e191 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:24.701107 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1b60efe5-7372-4e99-ad8b-c741b154e191 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:24.701847 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1b60efe5-7372-4e99-ad8b-c741b154e191 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:24.702284 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1b60efe5-7372-4e99-ad8b-c741b154e191 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:24.702986 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1b60efe5-7372-4e99-ad8b-c741b154e191 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:24.703606 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1b60efe5-7372-4e99-ad8b-c741b154e191 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:24.704199 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1b60efe5-7372-4e99-ad8b-c741b154e191 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:24.879195 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1b60efe5-7372-4e99-ad8b-c741b154e191 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:24.887715 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1b60efe5-7372-4e99-ad8b-c741b154e191 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1464 microversion: 2.1 time: 0.199057 Oct 14 03:15:24.889144 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 514/1014] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:24 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1464 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:15:24.938219 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9b056d0d-04bd-456a-950d-01febbd1b6ac tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:24.938837 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9b056d0d-04bd-456a-950d-01febbd1b6ac tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:24.946108 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b056d0d-04bd-456a-950d-01febbd1b6ac tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:24.946682 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b056d0d-04bd-456a-950d-01febbd1b6ac tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:24.947350 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b056d0d-04bd-456a-950d-01febbd1b6ac tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:24.948538 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b056d0d-04bd-456a-950d-01febbd1b6ac tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:24.949243 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b056d0d-04bd-456a-950d-01febbd1b6ac tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:24.949831 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b056d0d-04bd-456a-950d-01febbd1b6ac tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:24.977235 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9b056d0d-04bd-456a-950d-01febbd1b6ac tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Going to try to terminate instance {{(pid=119302) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:15:25.331595 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9b056d0d-04bd-456a-950d-01febbd1b6ac tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 204 len: 0 microversion: 2.1 time: 0.397593 Oct 14 03:15:25.332193 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 501/1015] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:15:24 2022] DELETE /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:15:25.341335 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f63c60e9-9b0f-41dd-bb3d-5b11327ec410 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:25.341948 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f63c60e9-9b0f-41dd-bb3d-5b11327ec410 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:25.347850 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f63c60e9-9b0f-41dd-bb3d-5b11327ec410 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:25.348265 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f63c60e9-9b0f-41dd-bb3d-5b11327ec410 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:25.348772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f63c60e9-9b0f-41dd-bb3d-5b11327ec410 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:25.349460 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f63c60e9-9b0f-41dd-bb3d-5b11327ec410 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:25.349913 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f63c60e9-9b0f-41dd-bb3d-5b11327ec410 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:25.350331 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f63c60e9-9b0f-41dd-bb3d-5b11327ec410 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:25.486148 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f63c60e9-9b0f-41dd-bb3d-5b11327ec410 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:25.494589 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f63c60e9-9b0f-41dd-bb3d-5b11327ec410 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1470 microversion: 2.1 time: 0.157954 Oct 14 03:15:25.495676 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 515/1016] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:25 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:15:26.518420 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f0deaea6-6bac-482f-bb1a-90f5f438c726 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:26.519164 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f0deaea6-6bac-482f-bb1a-90f5f438c726 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:26.525532 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f0deaea6-6bac-482f-bb1a-90f5f438c726 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:26.526024 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f0deaea6-6bac-482f-bb1a-90f5f438c726 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:26.526830 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f0deaea6-6bac-482f-bb1a-90f5f438c726 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:26.527274 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f0deaea6-6bac-482f-bb1a-90f5f438c726 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:26.527888 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f0deaea6-6bac-482f-bb1a-90f5f438c726 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:26.528187 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f0deaea6-6bac-482f-bb1a-90f5f438c726 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:26.687793 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-f0deaea6-6bac-482f-bb1a-90f5f438c726 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:26.694563 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f0deaea6-6bac-482f-bb1a-90f5f438c726 tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1470 microversion: 2.1 time: 0.180392 Oct 14 03:15:26.695133 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 502/1017] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:26 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:15:27.406730 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-623a6df6-af4e-42e3-b45f-eda15ffb285b req-924b0867-36e7-4e49-bdc5-69dd114ea2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae", "name": "network-vif-deleted", "tag": "823f51c5-d93f-47a6-b4f4-68a38288acd6"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:15:27.417661 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-623a6df6-af4e-42e3-b45f-eda15ffb285b req-924b0867-36e7-4e49-bdc5-69dd114ea2e6 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:27.418164 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-623a6df6-af4e-42e3-b45f-eda15ffb285b req-924b0867-36e7-4e49-bdc5-69dd114ea2e6 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:27.418621 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-623a6df6-af4e-42e3-b45f-eda15ffb285b req-924b0867-36e7-4e49-bdc5-69dd114ea2e6 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:27.430947 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-623a6df6-af4e-42e3-b45f-eda15ffb285b req-924b0867-36e7-4e49-bdc5-69dd114ea2e6 service nova] Creating event network-vif-deleted:823f51c5-d93f-47a6-b4f4-68a38288acd6 for instance 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae on hv-cinder-80152 Oct 14 03:15:27.436631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-623a6df6-af4e-42e3-b45f-eda15ffb285b req-924b0867-36e7-4e49-bdc5-69dd114ea2e6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038425 Oct 14 03:15:27.437327 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 516/1018] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:15:27.718352 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-66828888-7788-4b7d-97ff-6d960221542b tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:27.719305 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-66828888-7788-4b7d-97ff-6d960221542b tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:27.726163 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66828888-7788-4b7d-97ff-6d960221542b tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:27.730949 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66828888-7788-4b7d-97ff-6d960221542b tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:27.730949 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66828888-7788-4b7d-97ff-6d960221542b tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:27.730949 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66828888-7788-4b7d-97ff-6d960221542b tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:27.730949 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66828888-7788-4b7d-97ff-6d960221542b tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:27.731876 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66828888-7788-4b7d-97ff-6d960221542b tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:27.762500 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66828888-7788-4b7d-97ff-6d960221542b tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:27.762999 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66828888-7788-4b7d-97ff-6d960221542b tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:27.763445 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-66828888-7788-4b7d-97ff-6d960221542b tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:27.763899 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.objects.instance [None req-66828888-7788-4b7d-97ff-6d960221542b tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lazy-loading 'fault' on Instance uuid 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae {{(pid=119302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:15:27.804612 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-66828888-7788-4b7d-97ff-6d960221542b tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecd6112f824d4eafb2f51518b5e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6117dd60941f4804899175ecf89aefa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:27.814581 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-66828888-7788-4b7d-97ff-6d960221542b tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 200 len: 1304 microversion: 2.1 time: 0.100665 Oct 14 03:15:27.815255 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 503/1019] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:27 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:15:28.839272 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1dbe766d-34a2-4d00-a33a-dcad4ab9392a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:28.840093 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1dbe766d-34a2-4d00-a33a-dcad4ab9392a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] [instance: 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:28.847987 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1dbe766d-34a2-4d00-a33a-dcad4ab9392a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:28.848680 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1dbe766d-34a2-4d00-a33a-dcad4ab9392a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:28.849168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1dbe766d-34a2-4d00-a33a-dcad4ab9392a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:28.849863 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1dbe766d-34a2-4d00-a33a-dcad4ab9392a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:28.850396 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1dbe766d-34a2-4d00-a33a-dcad4ab9392a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:28.850876 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1dbe766d-34a2-4d00-a33a-dcad4ab9392a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:28.864787 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-1dbe766d-34a2-4d00-a33a-dcad4ab9392a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] HTTP exception thrown: Instance 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae could not be found. Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1dbe766d-34a2-4d00-a33a-dcad4ab9392a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Request method failure captured: Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae HTTP/1.1 Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNQ8hznzA_2gvcFmQLIuSL9QPhZTY4j5PL3wMqIr9U4uyq6YRO5pZpjowtyGELFhZ8EJXgFAC--kgZ7CQ-r387dAX3YDnc5MuPnjqn3BKhQ6MorFpiyHtziSUh_SLhEcqPZiJYTJjr6LmCyLW9jfN54V_aNR30wDWu9ef9iY59zWLMQ Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 6117dd60941f4804899175ecf89aefa4 Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-VolumesNegativeTest-1070256259 Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:15:28.866692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:15:28.868357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6117dd60941f4804899175ecf89aefa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6117dd60941f4804899175ecf89aefa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6117dd60941f4804899175ecf89aefa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6117dd60941f4804899175ecf89aefa4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:15:28.868357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-VolumesNegativeTest-1070256259 Oct 14 03:15:28.868357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 6117dd60941f4804899175ecf89aefa4 Oct 14 03:15:28.868357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-VolumesNegativeTest-1070256259 Oct 14 03:15:28.868357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-VolumesNegativeTest-1070256259-project Oct 14 03:15:28.868357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:15:28.868357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:15:28.868357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 20ecd6112f824d4eafb2f51518b5e873 Oct 14 03:15:28.868357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-VolumesNegativeTest-1070256259-project Oct 14 03:15:28.868357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:15:28.868357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae could not be found. Oct 14 03:15:28.868357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae'} Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae could not be found. Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:15:28.869422 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae could not be found. Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae could not be found. Oct 14 03:15:28.870720 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:15:28.872896 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1dbe766d-34a2-4d00-a33a-dcad4ab9392a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] Returning 404 to user: Instance 5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:15:28.872896 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1dbe766d-34a2-4d00-a33a-dcad4ab9392a tempest-VolumesNegativeTest-1070256259 tempest-VolumesNegativeTest-1070256259-project] 10.222.0.13 "GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae" status: 404 len: 111 microversion: 2.1 time: 0.033884 Oct 14 03:15:28.872896 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 517/1020] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:15:28 2022] GET /compute/v2.1/servers/5ce323eb-c4fe-40aa-b8ee-df2400f9d5ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:16:05.720441 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-555842444", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "networks": [{"uuid": "f4027bb8-c731-4028-aa76-fe118db4ed05"}]}} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:05.729788 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:05.730602 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:05.780118 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.network.neutron [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] validate_networks() for [('f4027bb8-c731-4028-aa76-fe118db4ed05', None, None, None, None, None)] {{(pid=119302) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:16:06.119931 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Flavor limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:16:06.120360 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Image limits 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:16:06.120868 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Flavor pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:16:06.121281 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Image pref 0:0:0 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:16:06.121698 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.virt.hardware [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:16:06.130378 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:06.130860 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:06.131298 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:06.132657 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:06.133124 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:06.133554 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:06.149843 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Getting quotas for project afe5d8b30620426aa0f7ee63ee9829da. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:16:06.153766 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.quota [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Getting quotas for user 1fbc2adc111449ef94bc8d9c4f55d9e8 and project afe5d8b30620426aa0f7ee63ee9829da. Resources: {'instances', 'ram', 'cores'} {{(pid=119302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:16:06.164520 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Going to run 1 instances... {{(pid=119302) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:16:06.167058 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:16:06.340762 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-cc69dad6-c2ba-4eac-9089-8b993437ca20 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624256 Oct 14 03:16:06.341411 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 504/1021] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:16:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:16:06.353524 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-cfc51156-169e-4251-9c84-7e218eade43b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:06.354191 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-cfc51156-169e-4251-9c84-7e218eade43b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:06.356464 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:06.357215 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:06.409631 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-cfc51156-169e-4251-9c84-7e218eade43b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:06.417242 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-cfc51156-169e-4251-9c84-7e218eade43b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 200 len: 1213 microversion: 2.1 time: 0.068432 Oct 14 03:16:06.417803 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 518/1022] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:06 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:07.441517 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b467e3c7-051c-4dc5-9155-09bcf608a1c6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:07.442209 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b467e3c7-051c-4dc5-9155-09bcf608a1c6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:07.452115 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b467e3c7-051c-4dc5-9155-09bcf608a1c6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:07.459671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b467e3c7-051c-4dc5-9155-09bcf608a1c6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:07.459671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b467e3c7-051c-4dc5-9155-09bcf608a1c6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:07.459671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b467e3c7-051c-4dc5-9155-09bcf608a1c6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:07.459671 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b467e3c7-051c-4dc5-9155-09bcf608a1c6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:07.460041 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b467e3c7-051c-4dc5-9155-09bcf608a1c6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:07.514867 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b467e3c7-051c-4dc5-9155-09bcf608a1c6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:07.522568 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b467e3c7-051c-4dc5-9155-09bcf608a1c6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 200 len: 1217 microversion: 2.1 time: 0.085896 Oct 14 03:16:07.523781 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 505/1023] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:07 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:08.546772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d41df0b5-1c2d-441a-9a2c-579f1853712d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:08.547382 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d41df0b5-1c2d-441a-9a2c-579f1853712d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:08.558073 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d41df0b5-1c2d-441a-9a2c-579f1853712d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:08.558504 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d41df0b5-1c2d-441a-9a2c-579f1853712d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:08.558937 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d41df0b5-1c2d-441a-9a2c-579f1853712d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:08.559632 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d41df0b5-1c2d-441a-9a2c-579f1853712d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:08.560106 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d41df0b5-1c2d-441a-9a2c-579f1853712d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:08.560558 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d41df0b5-1c2d-441a-9a2c-579f1853712d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:08.622602 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d41df0b5-1c2d-441a-9a2c-579f1853712d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:08.630044 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d41df0b5-1c2d-441a-9a2c-579f1853712d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 200 len: 1265 microversion: 2.1 time: 0.087751 Oct 14 03:16:08.630603 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 519/1024] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:08 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:09.657514 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-18ebaf56-2711-4324-ab79-d0156f5a28ad tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:09.658132 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-18ebaf56-2711-4324-ab79-d0156f5a28ad tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:09.664644 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-18ebaf56-2711-4324-ab79-d0156f5a28ad tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:09.665148 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-18ebaf56-2711-4324-ab79-d0156f5a28ad tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:09.665574 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-18ebaf56-2711-4324-ab79-d0156f5a28ad tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:09.666273 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-18ebaf56-2711-4324-ab79-d0156f5a28ad tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:09.666998 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-18ebaf56-2711-4324-ab79-d0156f5a28ad tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:09.667430 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-18ebaf56-2711-4324-ab79-d0156f5a28ad tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:09.802956 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-18ebaf56-2711-4324-ab79-d0156f5a28ad tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:09.811731 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-18ebaf56-2711-4324-ab79-d0156f5a28ad tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 200 len: 1313 microversion: 2.1 time: 0.158302 Oct 14 03:16:09.812414 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 506/1025] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:09 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:10.476057 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-7d12c008-c9b7-4ef7-8183-e493c79b6ee5 req-9b516227-fc6a-4ac0-a4a8-ee23ace6dca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af379199-b317-45a2-80cb-5e16749b3685", "tag": "bd516241-e28e-488d-8668-9d7935484675"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:10.487533 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-7d12c008-c9b7-4ef7-8183-e493c79b6ee5 req-9b516227-fc6a-4ac0-a4a8-ee23ace6dca0 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:10.488085 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-7d12c008-c9b7-4ef7-8183-e493c79b6ee5 req-9b516227-fc6a-4ac0-a4a8-ee23ace6dca0 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:10.488556 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-7d12c008-c9b7-4ef7-8183-e493c79b6ee5 req-9b516227-fc6a-4ac0-a4a8-ee23ace6dca0 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:10.500029 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-7d12c008-c9b7-4ef7-8183-e493c79b6ee5 req-9b516227-fc6a-4ac0-a4a8-ee23ace6dca0 service nova] Creating event network-changed:bd516241-e28e-488d-8668-9d7935484675 for instance af379199-b317-45a2-80cb-5e16749b3685 on hv-cinder-80152 Oct 14 03:16:10.505095 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-7d12c008-c9b7-4ef7-8183-e493c79b6ee5 req-9b516227-fc6a-4ac0-a4a8-ee23ace6dca0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032784 Oct 14 03:16:10.505702 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 520/1026] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:16:10.838945 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2accca84-58cf-4bfd-a1ab-4cd1f6f33d78 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:10.839567 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2accca84-58cf-4bfd-a1ab-4cd1f6f33d78 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:10.846053 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2accca84-58cf-4bfd-a1ab-4cd1f6f33d78 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:10.846544 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2accca84-58cf-4bfd-a1ab-4cd1f6f33d78 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:10.846985 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2accca84-58cf-4bfd-a1ab-4cd1f6f33d78 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:10.847685 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2accca84-58cf-4bfd-a1ab-4cd1f6f33d78 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:10.848147 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2accca84-58cf-4bfd-a1ab-4cd1f6f33d78 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:10.848609 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2accca84-58cf-4bfd-a1ab-4cd1f6f33d78 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:10.976292 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2accca84-58cf-4bfd-a1ab-4cd1f6f33d78 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:10.984457 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2accca84-58cf-4bfd-a1ab-4cd1f6f33d78 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 200 len: 1313 microversion: 2.1 time: 0.150064 Oct 14 03:16:10.985043 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 507/1027] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:10 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:12.009062 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-44427cd9-8b0b-47aa-874e-9395b21a03fc tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:12.009669 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-44427cd9-8b0b-47aa-874e-9395b21a03fc tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:12.015693 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-44427cd9-8b0b-47aa-874e-9395b21a03fc tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:12.016179 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-44427cd9-8b0b-47aa-874e-9395b21a03fc tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:12.016656 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-44427cd9-8b0b-47aa-874e-9395b21a03fc tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:12.017351 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-44427cd9-8b0b-47aa-874e-9395b21a03fc tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:12.017809 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-44427cd9-8b0b-47aa-874e-9395b21a03fc tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:12.018238 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-44427cd9-8b0b-47aa-874e-9395b21a03fc tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:12.146845 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-44427cd9-8b0b-47aa-874e-9395b21a03fc tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:12.154426 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-44427cd9-8b0b-47aa-874e-9395b21a03fc tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 200 len: 1313 microversion: 2.1 time: 0.150774 Oct 14 03:16:12.154988 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 521/1028] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:12 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:13.177153 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8158dfe7-3ce3-4ef5-a9fc-cba43271962b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:13.177767 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8158dfe7-3ce3-4ef5-a9fc-cba43271962b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:13.184965 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8158dfe7-3ce3-4ef5-a9fc-cba43271962b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:13.185447 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8158dfe7-3ce3-4ef5-a9fc-cba43271962b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:13.186578 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8158dfe7-3ce3-4ef5-a9fc-cba43271962b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:13.187300 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8158dfe7-3ce3-4ef5-a9fc-cba43271962b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:13.187794 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8158dfe7-3ce3-4ef5-a9fc-cba43271962b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:13.188246 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8158dfe7-3ce3-4ef5-a9fc-cba43271962b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:13.319039 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8158dfe7-3ce3-4ef5-a9fc-cba43271962b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:13.327203 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8158dfe7-3ce3-4ef5-a9fc-cba43271962b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 200 len: 1313 microversion: 2.1 time: 0.153862 Oct 14 03:16:13.327773 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 508/1029] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:13 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:14.350784 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-b24b8a97-c2cd-4d61-8040-46efd6cfb2d9 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:14.351406 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-b24b8a97-c2cd-4d61-8040-46efd6cfb2d9 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:14.357811 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b24b8a97-c2cd-4d61-8040-46efd6cfb2d9 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:14.358301 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b24b8a97-c2cd-4d61-8040-46efd6cfb2d9 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:14.358743 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b24b8a97-c2cd-4d61-8040-46efd6cfb2d9 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:14.359440 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b24b8a97-c2cd-4d61-8040-46efd6cfb2d9 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:14.359899 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b24b8a97-c2cd-4d61-8040-46efd6cfb2d9 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:14.360326 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-b24b8a97-c2cd-4d61-8040-46efd6cfb2d9 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:14.487429 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-b24b8a97-c2cd-4d61-8040-46efd6cfb2d9 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:14.495566 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-b24b8a97-c2cd-4d61-8040-46efd6cfb2d9 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 200 len: 1313 microversion: 2.1 time: 0.148726 Oct 14 03:16:14.496120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 522/1030] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:14 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:15.519051 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-84b62e14-f752-48cb-885e-6cc6399ca726 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:15.519714 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-84b62e14-f752-48cb-885e-6cc6399ca726 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:15.526976 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-84b62e14-f752-48cb-885e-6cc6399ca726 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:15.527520 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-84b62e14-f752-48cb-885e-6cc6399ca726 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:15.528028 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-84b62e14-f752-48cb-885e-6cc6399ca726 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:15.528867 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-84b62e14-f752-48cb-885e-6cc6399ca726 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:15.529396 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-84b62e14-f752-48cb-885e-6cc6399ca726 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:15.529827 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-84b62e14-f752-48cb-885e-6cc6399ca726 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:15.622588 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-88219864-f182-4c23-8bf8-760de521c914 req-4c350c03-4e21-4a27-87e5-01a0f97bc2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af379199-b317-45a2-80cb-5e16749b3685", "name": "network-vif-plugged", "status": "completed", "tag": "bd516241-e28e-488d-8668-9d7935484675"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:15.633575 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-88219864-f182-4c23-8bf8-760de521c914 req-4c350c03-4e21-4a27-87e5-01a0f97bc2f1 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:15.634069 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-88219864-f182-4c23-8bf8-760de521c914 req-4c350c03-4e21-4a27-87e5-01a0f97bc2f1 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:15.634612 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-88219864-f182-4c23-8bf8-760de521c914 req-4c350c03-4e21-4a27-87e5-01a0f97bc2f1 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:15.645989 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-88219864-f182-4c23-8bf8-760de521c914 req-4c350c03-4e21-4a27-87e5-01a0f97bc2f1 service nova] Creating event network-vif-plugged:bd516241-e28e-488d-8668-9d7935484675 for instance af379199-b317-45a2-80cb-5e16749b3685 on hv-cinder-80152 Oct 14 03:16:15.652304 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-88219864-f182-4c23-8bf8-760de521c914 req-4c350c03-4e21-4a27-87e5-01a0f97bc2f1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033391 Oct 14 03:16:15.653100 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 523/1031] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:16:15.667961 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-84b62e14-f752-48cb-885e-6cc6399ca726 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:15.676246 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-84b62e14-f752-48cb-885e-6cc6399ca726 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 200 len: 1313 microversion: 2.1 time: 0.161162 Oct 14 03:16:15.676875 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 509/1032] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:15 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:16.699487 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fae633cb-9d6b-4283-aab5-6d717a097d02 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:16.700180 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fae633cb-9d6b-4283-aab5-6d717a097d02 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:16.702164 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=2 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:16.707576 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fae633cb-9d6b-4283-aab5-6d717a097d02 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:16.708059 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fae633cb-9d6b-4283-aab5-6d717a097d02 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:16.708511 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fae633cb-9d6b-4283-aab5-6d717a097d02 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:16.709238 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fae633cb-9d6b-4283-aab5-6d717a097d02 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:16.709688 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fae633cb-9d6b-4283-aab5-6d717a097d02 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:16.710110 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fae633cb-9d6b-4283-aab5-6d717a097d02 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:16.841247 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fae633cb-9d6b-4283-aab5-6d717a097d02 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:16.846061 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fae633cb-9d6b-4283-aab5-6d717a097d02 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 200 len: 1313 microversion: 2.1 time: 0.151378 Oct 14 03:16:16.846621 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 524/1033] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:16 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:17.869911 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-501be939-494d-4a4c-a671-90f436750d1a tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:17.870527 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-501be939-494d-4a4c-a671-90f436750d1a tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:17.872335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=2 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:17.873045 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=6 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:17.878273 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-501be939-494d-4a4c-a671-90f436750d1a tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:17.879111 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-501be939-494d-4a4c-a671-90f436750d1a tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:17.879284 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-501be939-494d-4a4c-a671-90f436750d1a tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:17.879969 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-501be939-494d-4a4c-a671-90f436750d1a tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:17.880448 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-501be939-494d-4a4c-a671-90f436750d1a tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:17.880876 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-501be939-494d-4a4c-a671-90f436750d1a tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:18.009976 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-501be939-494d-4a4c-a671-90f436750d1a tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:18.017579 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-501be939-494d-4a4c-a671-90f436750d1a tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 200 len: 1496 microversion: 2.1 time: 0.152129 Oct 14 03:16:18.018142 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 510/1034] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:17 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 1496 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:18.819334 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ab861b3d-bbc0-4bae-bd18-65e329c28337 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:18.819826 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ab861b3d-bbc0-4bae-bd18-65e329c28337 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:18.826077 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab861b3d-bbc0-4bae-bd18-65e329c28337 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:18.826564 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab861b3d-bbc0-4bae-bd18-65e329c28337 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:18.827005 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab861b3d-bbc0-4bae-bd18-65e329c28337 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:18.827697 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab861b3d-bbc0-4bae-bd18-65e329c28337 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:18.828183 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab861b3d-bbc0-4bae-bd18-65e329c28337 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:18.828607 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ab861b3d-bbc0-4bae-bd18-65e329c28337 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:18.854138 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ab861b3d-bbc0-4bae-bd18-65e329c28337 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Going to try to terminate instance {{(pid=119301) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:16:19.146822 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ab861b3d-bbc0-4bae-bd18-65e329c28337 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "DELETE /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 204 len: 0 microversion: 2.1 time: 0.331088 Oct 14 03:16:19.147418 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 525/1035] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:16:18 2022] DELETE /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:16:19.156128 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e47776e2-2a58-40da-b2f1-13b1d76afd76 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:19.156789 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e47776e2-2a58-40da-b2f1-13b1d76afd76 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:19.163330 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e47776e2-2a58-40da-b2f1-13b1d76afd76 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:19.163809 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e47776e2-2a58-40da-b2f1-13b1d76afd76 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:19.164253 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e47776e2-2a58-40da-b2f1-13b1d76afd76 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:19.165024 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e47776e2-2a58-40da-b2f1-13b1d76afd76 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:19.165484 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e47776e2-2a58-40da-b2f1-13b1d76afd76 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:19.165915 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e47776e2-2a58-40da-b2f1-13b1d76afd76 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:19.294410 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e47776e2-2a58-40da-b2f1-13b1d76afd76 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:19.301987 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e47776e2-2a58-40da-b2f1-13b1d76afd76 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 200 len: 1502 microversion: 2.1 time: 0.149738 Oct 14 03:16:19.302582 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 511/1036] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:19 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:20.325583 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-ffb2561a-8297-46c6-9116-60af30d6fdb1 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:20.326290 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-ffb2561a-8297-46c6-9116-60af30d6fdb1 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:20.332615 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ffb2561a-8297-46c6-9116-60af30d6fdb1 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:20.333098 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ffb2561a-8297-46c6-9116-60af30d6fdb1 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:20.333539 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ffb2561a-8297-46c6-9116-60af30d6fdb1 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:20.334231 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ffb2561a-8297-46c6-9116-60af30d6fdb1 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:20.334685 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ffb2561a-8297-46c6-9116-60af30d6fdb1 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:20.335111 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-ffb2561a-8297-46c6-9116-60af30d6fdb1 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:20.464555 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-ffb2561a-8297-46c6-9116-60af30d6fdb1 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:20.472145 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-ffb2561a-8297-46c6-9116-60af30d6fdb1 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 200 len: 1502 microversion: 2.1 time: 0.150831 Oct 14 03:16:20.472741 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 526/1037] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:20 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:21.122430 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-8250a9e9-6c86-4809-8b3f-7a99602111da req-313e3281-3264-4ebc-ad5c-cfd09544b04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af379199-b317-45a2-80cb-5e16749b3685", "name": "network-vif-deleted", "tag": "bd516241-e28e-488d-8668-9d7935484675"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:21.132161 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-8250a9e9-6c86-4809-8b3f-7a99602111da req-313e3281-3264-4ebc-ad5c-cfd09544b04e service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:21.135033 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-8250a9e9-6c86-4809-8b3f-7a99602111da req-313e3281-3264-4ebc-ad5c-cfd09544b04e service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:21.135033 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-8250a9e9-6c86-4809-8b3f-7a99602111da req-313e3281-3264-4ebc-ad5c-cfd09544b04e service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:21.144870 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-8250a9e9-6c86-4809-8b3f-7a99602111da req-313e3281-3264-4ebc-ad5c-cfd09544b04e service nova] Creating event network-vif-deleted:bd516241-e28e-488d-8668-9d7935484675 for instance af379199-b317-45a2-80cb-5e16749b3685 on hv-cinder-80152 Oct 14 03:16:21.149960 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-8250a9e9-6c86-4809-8b3f-7a99602111da req-313e3281-3264-4ebc-ad5c-cfd09544b04e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031690 Oct 14 03:16:21.152155 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 512/1038] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:16:21.496219 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-2cce42b6-67a2-4918-a0c2-285d29f95e5d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:21.496864 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-2cce42b6-67a2-4918-a0c2-285d29f95e5d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:21.503187 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2cce42b6-67a2-4918-a0c2-285d29f95e5d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:21.503664 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2cce42b6-67a2-4918-a0c2-285d29f95e5d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:21.504094 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2cce42b6-67a2-4918-a0c2-285d29f95e5d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:21.504806 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2cce42b6-67a2-4918-a0c2-285d29f95e5d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:21.505259 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2cce42b6-67a2-4918-a0c2-285d29f95e5d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:21.505680 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2cce42b6-67a2-4918-a0c2-285d29f95e5d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:21.535704 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2cce42b6-67a2-4918-a0c2-285d29f95e5d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:21.536188 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2cce42b6-67a2-4918-a0c2-285d29f95e5d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:21.536806 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-2cce42b6-67a2-4918-a0c2-285d29f95e5d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:21.537079 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-2cce42b6-67a2-4918-a0c2-285d29f95e5d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lazy-loading 'fault' on Instance uuid af379199-b317-45a2-80cb-5e16749b3685 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:16:21.578808 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-2cce42b6-67a2-4918-a0c2-285d29f95e5d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:21.586596 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-2cce42b6-67a2-4918-a0c2-285d29f95e5d tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 200 len: 1303 microversion: 2.1 time: 0.094836 Oct 14 03:16:21.587690 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 527/1039] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:21 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:22.610949 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-41eb5177-5163-41ab-8b7a-0103bc9006c0 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:22.611651 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-41eb5177-5163-41ab-8b7a-0103bc9006c0 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: af379199-b317-45a2-80cb-5e16749b3685] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:22.617775 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-41eb5177-5163-41ab-8b7a-0103bc9006c0 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:22.622622 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-41eb5177-5163-41ab-8b7a-0103bc9006c0 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:22.622622 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-41eb5177-5163-41ab-8b7a-0103bc9006c0 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:22.622622 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-41eb5177-5163-41ab-8b7a-0103bc9006c0 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:22.622622 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-41eb5177-5163-41ab-8b7a-0103bc9006c0 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:22.623015 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-41eb5177-5163-41ab-8b7a-0103bc9006c0 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:22.633060 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.wsgi [None req-41eb5177-5163-41ab-8b7a-0103bc9006c0 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] HTTP exception thrown: Instance af379199-b317-45a2-80cb-5e16749b3685 could not be found. Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-41eb5177-5163-41ab-8b7a-0103bc9006c0 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Request method failure captured: Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: request: GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 HTTP/1.1 Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept: application/json Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Accept-Encoding: identity Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Connection: close Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Length: 0 Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Content-Type: application/json Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Host: 10.222.0.13 Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Openstack-System-Scope: None Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: User-Agent: python-urllib3/1.26.12 Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Auth-Token: gAAAAABjSNRz5TnUJ8PnWM4zePYtdqI672SctrFsvFt2Vpl2oKXhtu28X6eOm3AnOHkUrYDpjJ8NGBz-7aNfTbpr_foWM4UPVaPlqfYex3bj4LJF6B0ugkiiyHYaNo7JbY4LMNWtw2lqbEkOOGKyeC9jQ0fsXbYzdLiXWszDnn0698nXo8qt3nE Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Id: None Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Domain-Name: None Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Identity-Status: Confirmed Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Is-Admin-Project: True Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Id: default Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Domain-Name: Default Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Id: afe5d8b30620426aa0f7ee63ee9829da Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Project-Name: tempest-VolumesActionsTest-1986777034 Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Role: member,reader Oct 14 03:16:22.634670 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Roles: member,reader Oct 14 03:16:22.636463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afe5d8b30620426aa0f7ee63ee9829da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afe5d8b30620426aa0f7ee63ee9829da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/afe5d8b30620426aa0f7ee63ee9829da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_afe5d8b30620426aa0f7ee63ee9829da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:16:22.636463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant: tempest-VolumesActionsTest-1986777034 Oct 14 03:16:22.636463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Id: afe5d8b30620426aa0f7ee63ee9829da Oct 14 03:16:22.636463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-Tenant-Name: tempest-VolumesActionsTest-1986777034 Oct 14 03:16:22.636463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User: tempest-VolumesActionsTest-1986777034-project Oct 14 03:16:22.636463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Id: default Oct 14 03:16:22.636463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Domain-Name: Default Oct 14 03:16:22.636463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Id: 1fbc2adc111449ef94bc8d9c4f55d9e8 Oct 14 03:16:22.636463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: X-User-Name: tempest-VolumesActionsTest-1986777034-project Oct 14 03:16:22.636463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: method: > Oct 14 03:16:22.636463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: exception: Instance af379199-b317-45a2-80cb-5e16749b3685 could not be found. Oct 14 03:16:22.636463 dv-cinder-801522-13-smb devstack@n-api.service[119302]: action_args: {'id': 'af379199-b317-45a2-80cb-5e16749b3685'} Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af379199-b317-45a2-80cb-5e16749b3685 could not be found. Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:16:22.642326 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af379199-b317-45a2-80cb-5e16749b3685 could not be found. Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af379199-b317-45a2-80cb-5e16749b3685 could not be found. Oct 14 03:16:22.644233 dv-cinder-801522-13-smb devstack@n-api.service[119302]: ERROR nova.api.openstack.wsgi Oct 14 03:16:22.645524 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-41eb5177-5163-41ab-8b7a-0103bc9006c0 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Returning 404 to user: Instance af379199-b317-45a2-80cb-5e16749b3685 could not be found. {{(pid=119302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:16:22.645524 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-41eb5177-5163-41ab-8b7a-0103bc9006c0 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685" status: 404 len: 111 microversion: 2.1 time: 0.029780 Oct 14 03:16:22.645524 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 513/1040] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:22 2022] GET /compute/v2.1/servers/af379199-b317-45a2-80cb-5e16749b3685 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:16:22.688091 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-947527703", "imageRef": "271f2964-de60-4387-a39e-92befb6d8ceb", "flavorRef": "452", "networks": [{"uuid": "f4027bb8-c731-4028-aa76-fe118db4ed05"}]}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:22.745277 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.network.neutron [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] validate_networks() for [('f4027bb8-c731-4028-aa76-fe118db4ed05', None, None, None, None, None)] {{(pid=119301) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:16:23.124908 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Flavor limits 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:16:23.125337 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Image limits 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:16:23.125815 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Flavor pref 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:16:23.126224 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Image pref 0:0:0 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:16:23.126638 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.virt.hardware [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119301) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:16:23.135961 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:23.136468 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:23.136904 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:23.137634 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:23.138090 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:23.138516 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:23.154636 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Getting quotas for project afe5d8b30620426aa0f7ee63ee9829da. Resources: {'instances', 'ram', 'cores'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:16:23.158543 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.quota [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Getting quotas for user 1fbc2adc111449ef94bc8d9c4f55d9e8 and project afe5d8b30620426aa0f7ee63ee9829da. Resources: {'instances', 'ram', 'cores'} {{(pid=119301) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:16:23.169352 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Going to run 1 instances... {{(pid=119301) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:16:23.171607 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='271f2964-de60-4387-a39e-92befb6d8ceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119301) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:16:23.296587 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-69a5ef2a-56ae-4eb9-b071-55152b6c0e81 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613770 Oct 14 03:16:23.297247 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 528/1041] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Oct 14 03:16:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:16:23.309028 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-30d177fc-f85f-4bbb-a807-b826a24c395c tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:23.309652 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-30d177fc-f85f-4bbb-a807-b826a24c395c tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:23.362837 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-30d177fc-f85f-4bbb-a807-b826a24c395c tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:23.370375 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-30d177fc-f85f-4bbb-a807-b826a24c395c tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 200 len: 1213 microversion: 2.1 time: 0.065242 Oct 14 03:16:23.371127 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 514/1042] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:23 2022] GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:24.392524 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-93283112-e6aa-4e72-9cb8-cb7fb8028e48 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:24.393137 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-93283112-e6aa-4e72-9cb8-cb7fb8028e48 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:24.400166 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-93283112-e6aa-4e72-9cb8-cb7fb8028e48 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:24.400675 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-93283112-e6aa-4e72-9cb8-cb7fb8028e48 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:24.401112 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-93283112-e6aa-4e72-9cb8-cb7fb8028e48 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:24.401829 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-93283112-e6aa-4e72-9cb8-cb7fb8028e48 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:24.402266 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-93283112-e6aa-4e72-9cb8-cb7fb8028e48 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:24.402692 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-93283112-e6aa-4e72-9cb8-cb7fb8028e48 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:24.463862 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-93283112-e6aa-4e72-9cb8-cb7fb8028e48 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:24.471415 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-93283112-e6aa-4e72-9cb8-cb7fb8028e48 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 200 len: 1217 microversion: 2.1 time: 0.082939 Oct 14 03:16:24.471971 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 529/1043] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:24 2022] GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:25.494887 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-2d4c71b0-3f2b-4371-be46-0941a547ee8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:25.495500 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-2d4c71b0-3f2b-4371-be46-0941a547ee8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:25.503228 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d4c71b0-3f2b-4371-be46-0941a547ee8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:25.503718 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d4c71b0-3f2b-4371-be46-0941a547ee8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:25.504156 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d4c71b0-3f2b-4371-be46-0941a547ee8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:25.504878 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d4c71b0-3f2b-4371-be46-0941a547ee8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:25.505333 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d4c71b0-3f2b-4371-be46-0941a547ee8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:25.505756 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-2d4c71b0-3f2b-4371-be46-0941a547ee8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:25.568978 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-2d4c71b0-3f2b-4371-be46-0941a547ee8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:25.577415 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-2d4c71b0-3f2b-4371-be46-0941a547ee8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 200 len: 1271 microversion: 2.1 time: 0.086386 Oct 14 03:16:25.578220 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 515/1044] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:25 2022] GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:26.599619 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-1f2db30b-be24-4b34-9510-38ab2f930625 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:26.600230 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-1f2db30b-be24-4b34-9510-38ab2f930625 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:26.607357 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1f2db30b-be24-4b34-9510-38ab2f930625 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:26.607841 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1f2db30b-be24-4b34-9510-38ab2f930625 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:26.608283 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1f2db30b-be24-4b34-9510-38ab2f930625 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:26.609001 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1f2db30b-be24-4b34-9510-38ab2f930625 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:26.609451 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1f2db30b-be24-4b34-9510-38ab2f930625 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:26.609872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-1f2db30b-be24-4b34-9510-38ab2f930625 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:26.745050 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-1f2db30b-be24-4b34-9510-38ab2f930625 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:26.753332 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-1f2db30b-be24-4b34-9510-38ab2f930625 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 200 len: 1313 microversion: 2.1 time: 0.157717 Oct 14 03:16:26.753915 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 530/1045] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:26 2022] GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:26.850366 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-4e2332e1-3e41-4cc8-a5a9-6a680af2198d req-fa22b3b2-0cfd-4b87-9b11-dbf8aeb5d086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e52230-0b5f-40d0-9464-29013d763e38", "tag": "0fff69e8-645c-41d0-8caf-2809534150b1"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:26.861059 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-4e2332e1-3e41-4cc8-a5a9-6a680af2198d req-fa22b3b2-0cfd-4b87-9b11-dbf8aeb5d086 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:26.861656 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-4e2332e1-3e41-4cc8-a5a9-6a680af2198d req-fa22b3b2-0cfd-4b87-9b11-dbf8aeb5d086 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:26.862096 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-4e2332e1-3e41-4cc8-a5a9-6a680af2198d req-fa22b3b2-0cfd-4b87-9b11-dbf8aeb5d086 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:26.873130 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-4e2332e1-3e41-4cc8-a5a9-6a680af2198d req-fa22b3b2-0cfd-4b87-9b11-dbf8aeb5d086 service nova] Creating event network-changed:0fff69e8-645c-41d0-8caf-2809534150b1 for instance 62e52230-0b5f-40d0-9464-29013d763e38 on hv-cinder-80152 Oct 14 03:16:26.878242 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-4e2332e1-3e41-4cc8-a5a9-6a680af2198d req-fa22b3b2-0cfd-4b87-9b11-dbf8aeb5d086 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031669 Oct 14 03:16:26.879146 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 516/1046] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:16:27.774938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-049e59cf-4d89-47e4-b1d1-4aeff07f38fe tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:27.776177 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-049e59cf-4d89-47e4-b1d1-4aeff07f38fe tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:27.782572 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-049e59cf-4d89-47e4-b1d1-4aeff07f38fe tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:27.783051 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-049e59cf-4d89-47e4-b1d1-4aeff07f38fe tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:27.783486 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-049e59cf-4d89-47e4-b1d1-4aeff07f38fe tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:27.784169 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-049e59cf-4d89-47e4-b1d1-4aeff07f38fe tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:27.784651 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-049e59cf-4d89-47e4-b1d1-4aeff07f38fe tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:27.785072 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-049e59cf-4d89-47e4-b1d1-4aeff07f38fe tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:27.917403 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-049e59cf-4d89-47e4-b1d1-4aeff07f38fe tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:27.925696 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-049e59cf-4d89-47e4-b1d1-4aeff07f38fe tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 200 len: 1313 microversion: 2.1 time: 0.154568 Oct 14 03:16:27.926252 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 531/1047] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:27 2022] GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:28.950548 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-8e75269d-0509-45d0-8d67-a3a24db67996 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:28.951282 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-8e75269d-0509-45d0-8d67-a3a24db67996 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:28.957417 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8e75269d-0509-45d0-8d67-a3a24db67996 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:28.957897 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8e75269d-0509-45d0-8d67-a3a24db67996 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:28.958336 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8e75269d-0509-45d0-8d67-a3a24db67996 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:28.959027 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8e75269d-0509-45d0-8d67-a3a24db67996 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:28.959483 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8e75269d-0509-45d0-8d67-a3a24db67996 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:28.959911 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-8e75269d-0509-45d0-8d67-a3a24db67996 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:29.085127 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-8e75269d-0509-45d0-8d67-a3a24db67996 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:29.092766 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-8e75269d-0509-45d0-8d67-a3a24db67996 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 200 len: 1313 microversion: 2.1 time: 0.147437 Oct 14 03:16:29.093336 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 517/1048] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:28 2022] GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:30.115182 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-fe1545eb-c406-4799-b392-ab26578700c2 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:30.115830 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-fe1545eb-c406-4799-b392-ab26578700c2 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:30.122497 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe1545eb-c406-4799-b392-ab26578700c2 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:30.122978 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe1545eb-c406-4799-b392-ab26578700c2 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:30.123421 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe1545eb-c406-4799-b392-ab26578700c2 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:30.124120 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe1545eb-c406-4799-b392-ab26578700c2 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:30.124617 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe1545eb-c406-4799-b392-ab26578700c2 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:30.125057 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-fe1545eb-c406-4799-b392-ab26578700c2 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:30.248945 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-fe1545eb-c406-4799-b392-ab26578700c2 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:30.256540 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-fe1545eb-c406-4799-b392-ab26578700c2 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 200 len: 1313 microversion: 2.1 time: 0.145231 Oct 14 03:16:30.257104 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 532/1049] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:30 2022] GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:31.279109 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-fdd6adb0-50cc-4780-8ba2-d9429d7879b6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:31.279718 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-fdd6adb0-50cc-4780-8ba2-d9429d7879b6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:31.286124 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdd6adb0-50cc-4780-8ba2-d9429d7879b6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:31.286617 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdd6adb0-50cc-4780-8ba2-d9429d7879b6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:31.287037 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdd6adb0-50cc-4780-8ba2-d9429d7879b6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:31.287724 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdd6adb0-50cc-4780-8ba2-d9429d7879b6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:31.288174 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdd6adb0-50cc-4780-8ba2-d9429d7879b6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:31.288620 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-fdd6adb0-50cc-4780-8ba2-d9429d7879b6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:31.426780 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-fdd6adb0-50cc-4780-8ba2-d9429d7879b6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:31.438605 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-fdd6adb0-50cc-4780-8ba2-d9429d7879b6 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 200 len: 1313 microversion: 2.1 time: 0.163331 Oct 14 03:16:31.439196 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 518/1050] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:31 2022] GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:31.701193 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-9c1ac79a-f6f7-443b-aab1-01d29c0a661d req-1a887c67-011e-4daa-aca8-4e77b8817115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e52230-0b5f-40d0-9464-29013d763e38", "name": "network-vif-plugged", "status": "completed", "tag": "0fff69e8-645c-41d0-8caf-2809534150b1"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:31.711350 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-9c1ac79a-f6f7-443b-aab1-01d29c0a661d req-1a887c67-011e-4daa-aca8-4e77b8817115 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:31.718297 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-9c1ac79a-f6f7-443b-aab1-01d29c0a661d req-1a887c67-011e-4daa-aca8-4e77b8817115 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:31.718297 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-9c1ac79a-f6f7-443b-aab1-01d29c0a661d req-1a887c67-011e-4daa-aca8-4e77b8817115 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:31.723881 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-9c1ac79a-f6f7-443b-aab1-01d29c0a661d req-1a887c67-011e-4daa-aca8-4e77b8817115 service nova] Creating event network-vif-plugged:0fff69e8-645c-41d0-8caf-2809534150b1 for instance 62e52230-0b5f-40d0-9464-29013d763e38 on hv-cinder-80152 Oct 14 03:16:31.728829 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-9c1ac79a-f6f7-443b-aab1-01d29c0a661d req-1a887c67-011e-4daa-aca8-4e77b8817115 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032071 Oct 14 03:16:31.729434 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 533/1051] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:16:32.464628 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-4bb860c6-6cdd-4312-b80d-67318ca9ac80 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:32.465185 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-4bb860c6-6cdd-4312-b80d-67318ca9ac80 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:32.471439 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4bb860c6-6cdd-4312-b80d-67318ca9ac80 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:32.471924 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4bb860c6-6cdd-4312-b80d-67318ca9ac80 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:32.472413 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4bb860c6-6cdd-4312-b80d-67318ca9ac80 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:32.473103 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4bb860c6-6cdd-4312-b80d-67318ca9ac80 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:32.473561 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4bb860c6-6cdd-4312-b80d-67318ca9ac80 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:32.473990 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-4bb860c6-6cdd-4312-b80d-67318ca9ac80 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:32.598486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-4bb860c6-6cdd-4312-b80d-67318ca9ac80 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:32.606003 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-4bb860c6-6cdd-4312-b80d-67318ca9ac80 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 200 len: 1313 microversion: 2.1 time: 0.145352 Oct 14 03:16:32.607289 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 519/1052] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:32 2022] GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:32.789232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-8bd736dc-92e3-4a57-ab9f-ba0f7e8a40c9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:32.789788 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-8bd736dc-92e3-4a57-ab9f-ba0f7e8a40c9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:32.796778 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8bd736dc-92e3-4a57-ab9f-ba0f7e8a40c9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:32.797265 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8bd736dc-92e3-4a57-ab9f-ba0f7e8a40c9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:32.797699 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8bd736dc-92e3-4a57-ab9f-ba0f7e8a40c9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:32.798394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8bd736dc-92e3-4a57-ab9f-ba0f7e8a40c9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:32.798881 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8bd736dc-92e3-4a57-ab9f-ba0f7e8a40c9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:32.799309 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-8bd736dc-92e3-4a57-ab9f-ba0f7e8a40c9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:32.821775 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-8bd736dc-92e3-4a57-ab9f-ba0f7e8a40c9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lazy-loading 'flavor' on Instance uuid 9c2c238c-787c-4bb0-b123-61e7d380c8b7 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:16:32.928223 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:33.144365 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-8bd736dc-92e3-4a57-ab9f-ba0f7e8a40c9 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "POST /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7/action" status: 202 len: 0 microversion: 2.1 time: 0.359771 Oct 14 03:16:33.144986 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 534/1053] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Oct 14 03:16:32 2022] POST /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:16:33.153695 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-47fe0b29-1fc9-44f1-83f7-115d1b3b1baa tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:33.154310 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-47fe0b29-1fc9-44f1-83f7-115d1b3b1baa tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:33.160193 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-47fe0b29-1fc9-44f1-83f7-115d1b3b1baa tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:33.160716 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-47fe0b29-1fc9-44f1-83f7-115d1b3b1baa tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:33.161154 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-47fe0b29-1fc9-44f1-83f7-115d1b3b1baa tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:33.161843 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-47fe0b29-1fc9-44f1-83f7-115d1b3b1baa tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:33.162301 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-47fe0b29-1fc9-44f1-83f7-115d1b3b1baa tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:33.162779 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-47fe0b29-1fc9-44f1-83f7-115d1b3b1baa tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:33.296470 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-47fe0b29-1fc9-44f1-83f7-115d1b3b1baa tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:33.304425 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-47fe0b29-1fc9-44f1-83f7-115d1b3b1baa tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.155051 Oct 14 03:16:33.305003 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 520/1054] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:33 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:33.627925 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=2 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:33.628718 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell0:SELECT=6 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:33.633072 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-454b465f-840d-40c9-87d3-109d091b3c8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:33.633776 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-454b465f-840d-40c9-87d3-109d091b3c8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:33.640705 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-454b465f-840d-40c9-87d3-109d091b3c8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:33.641189 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-454b465f-840d-40c9-87d3-109d091b3c8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:33.641630 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-454b465f-840d-40c9-87d3-109d091b3c8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:33.642325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-454b465f-840d-40c9-87d3-109d091b3c8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:33.642780 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-454b465f-840d-40c9-87d3-109d091b3c8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:33.643210 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-454b465f-840d-40c9-87d3-109d091b3c8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:33.770664 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-454b465f-840d-40c9-87d3-109d091b3c8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:33.778367 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-454b465f-840d-40c9-87d3-109d091b3c8f tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 200 len: 1497 microversion: 2.1 time: 0.151316 Oct 14 03:16:33.778928 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 535/1055] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:33 2022] GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:34.327070 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-96a8e7f8-4af1-42c0-a9c1-9a668700a698 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:34.327780 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-96a8e7f8-4af1-42c0-a9c1-9a668700a698 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:34.329940 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell0:SELECT=2 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:34.335241 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-96a8e7f8-4af1-42c0-a9c1-9a668700a698 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:34.335723 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-96a8e7f8-4af1-42c0-a9c1-9a668700a698 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:34.336157 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-96a8e7f8-4af1-42c0-a9c1-9a668700a698 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:34.336876 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-96a8e7f8-4af1-42c0-a9c1-9a668700a698 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:34.337330 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-96a8e7f8-4af1-42c0-a9c1-9a668700a698 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:34.337752 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-96a8e7f8-4af1-42c0-a9c1-9a668700a698 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:34.466456 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-96a8e7f8-4af1-42c0-a9c1-9a668700a698 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:34.474139 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-96a8e7f8-4af1-42c0-a9c1-9a668700a698 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.151112 Oct 14 03:16:34.474708 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 521/1056] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:34 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:34.604842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-543b98a3-f1ce-40ef-868b-4130c2388cf3 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:34.605372 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-543b98a3-f1ce-40ef-868b-4130c2388cf3 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:34.612442 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-543b98a3-f1ce-40ef-868b-4130c2388cf3 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:34.612931 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-543b98a3-f1ce-40ef-868b-4130c2388cf3 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:34.613363 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-543b98a3-f1ce-40ef-868b-4130c2388cf3 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:34.614050 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-543b98a3-f1ce-40ef-868b-4130c2388cf3 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:34.614503 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-543b98a3-f1ce-40ef-868b-4130c2388cf3 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:34.614925 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-543b98a3-f1ce-40ef-868b-4130c2388cf3 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:34.639267 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-543b98a3-f1ce-40ef-868b-4130c2388cf3 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Going to try to terminate instance {{(pid=119301) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:16:34.936894 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-543b98a3-f1ce-40ef-868b-4130c2388cf3 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "DELETE /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 204 len: 0 microversion: 2.1 time: 0.335506 Oct 14 03:16:34.937507 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 536/1057] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:16:34 2022] DELETE /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:16:34.945914 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-b98e726d-a964-4162-a74c-bfe5eb019b27 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:34.946569 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-b98e726d-a964-4162-a74c-bfe5eb019b27 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:34.953110 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b98e726d-a964-4162-a74c-bfe5eb019b27 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:34.953601 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b98e726d-a964-4162-a74c-bfe5eb019b27 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:34.954042 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b98e726d-a964-4162-a74c-bfe5eb019b27 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:34.954742 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b98e726d-a964-4162-a74c-bfe5eb019b27 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:34.955199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b98e726d-a964-4162-a74c-bfe5eb019b27 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:34.955629 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-b98e726d-a964-4162-a74c-bfe5eb019b27 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:35.083919 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-b98e726d-a964-4162-a74c-bfe5eb019b27 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:35.091502 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-b98e726d-a964-4162-a74c-bfe5eb019b27 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 200 len: 1503 microversion: 2.1 time: 0.149650 Oct 14 03:16:35.092069 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 522/1058] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:34 2022] GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:35.499490 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-10ce048d-ddff-4c7b-b13d-3dfeea395342 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:35.500186 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-10ce048d-ddff-4c7b-b13d-3dfeea395342 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:35.506056 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-10ce048d-ddff-4c7b-b13d-3dfeea395342 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:35.506539 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-10ce048d-ddff-4c7b-b13d-3dfeea395342 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:35.507001 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-10ce048d-ddff-4c7b-b13d-3dfeea395342 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:35.507689 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-10ce048d-ddff-4c7b-b13d-3dfeea395342 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:35.508145 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-10ce048d-ddff-4c7b-b13d-3dfeea395342 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:35.508606 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-10ce048d-ddff-4c7b-b13d-3dfeea395342 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:35.634028 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-10ce048d-ddff-4c7b-b13d-3dfeea395342 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:35.641750 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-10ce048d-ddff-4c7b-b13d-3dfeea395342 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.147127 Oct 14 03:16:35.642315 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 537/1059] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:35 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:36.114026 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-70a21b1c-3d98-4487-b0b0-3230d8795797 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:36.114633 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-70a21b1c-3d98-4487-b0b0-3230d8795797 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:36.117133 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:36.121946 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-70a21b1c-3d98-4487-b0b0-3230d8795797 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:36.126527 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-70a21b1c-3d98-4487-b0b0-3230d8795797 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:36.126527 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-70a21b1c-3d98-4487-b0b0-3230d8795797 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:36.126527 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-70a21b1c-3d98-4487-b0b0-3230d8795797 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:36.126527 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-70a21b1c-3d98-4487-b0b0-3230d8795797 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:36.127003 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-70a21b1c-3d98-4487-b0b0-3230d8795797 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:36.127103 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=93 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:36.256565 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-70a21b1c-3d98-4487-b0b0-3230d8795797 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:36.264852 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-70a21b1c-3d98-4487-b0b0-3230d8795797 tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 200 len: 1503 microversion: 2.1 time: 0.154837 Oct 14 03:16:36.265428 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 523/1060] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:36 2022] GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:36.665432 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-de4a85a8-9516-44fb-bd1a-287ba1e2afc4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:36.666046 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-de4a85a8-9516-44fb-bd1a-287ba1e2afc4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:36.672746 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-de4a85a8-9516-44fb-bd1a-287ba1e2afc4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:36.673236 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-de4a85a8-9516-44fb-bd1a-287ba1e2afc4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:36.673671 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-de4a85a8-9516-44fb-bd1a-287ba1e2afc4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:36.674373 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-de4a85a8-9516-44fb-bd1a-287ba1e2afc4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:36.674823 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-de4a85a8-9516-44fb-bd1a-287ba1e2afc4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:36.675772 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-de4a85a8-9516-44fb-bd1a-287ba1e2afc4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:36.808247 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-de4a85a8-9516-44fb-bd1a-287ba1e2afc4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:36.816609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-de4a85a8-9516-44fb-bd1a-287ba1e2afc4 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.155075 Oct 14 03:16:36.817181 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 538/1061] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:36 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:36.925592 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [req-2904e1fc-39e3-46a5-887d-9af9aff2c019 req-6981c06b-89fc-4b2a-8569-204ec9c1bb04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e52230-0b5f-40d0-9464-29013d763e38", "name": "network-vif-deleted", "tag": "0fff69e8-645c-41d0-8caf-2809534150b1"}]} {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:36.935426 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-2904e1fc-39e3-46a5-887d-9af9aff2c019 req-6981c06b-89fc-4b2a-8569-204ec9c1bb04 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:36.935907 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-2904e1fc-39e3-46a5-887d-9af9aff2c019 req-6981c06b-89fc-4b2a-8569-204ec9c1bb04 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:36.936336 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [req-2904e1fc-39e3-46a5-887d-9af9aff2c019 req-6981c06b-89fc-4b2a-8569-204ec9c1bb04 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:36.947096 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.compute.server_external_events [req-2904e1fc-39e3-46a5-887d-9af9aff2c019 req-6981c06b-89fc-4b2a-8569-204ec9c1bb04 service nova] Creating event network-vif-deleted:0fff69e8-645c-41d0-8caf-2809534150b1 for instance 62e52230-0b5f-40d0-9464-29013d763e38 on hv-cinder-80152 Oct 14 03:16:36.952238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [req-2904e1fc-39e3-46a5-887d-9af9aff2c019 req-6981c06b-89fc-4b2a-8569-204ec9c1bb04 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030330 Oct 14 03:16:36.952843 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 524/1062] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:16:37.288438 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a79d5784-dca2-416f-93a2-04359b8cdffb tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:37.289082 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a79d5784-dca2-416f-93a2-04359b8cdffb tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:37.296156 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a79d5784-dca2-416f-93a2-04359b8cdffb tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:37.296677 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a79d5784-dca2-416f-93a2-04359b8cdffb tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:37.297111 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a79d5784-dca2-416f-93a2-04359b8cdffb tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:37.297831 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a79d5784-dca2-416f-93a2-04359b8cdffb tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:37.298283 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a79d5784-dca2-416f-93a2-04359b8cdffb tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:37.298704 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a79d5784-dca2-416f-93a2-04359b8cdffb tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:37.330243 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a79d5784-dca2-416f-93a2-04359b8cdffb tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:37.330732 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a79d5784-dca2-416f-93a2-04359b8cdffb tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:37.331172 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a79d5784-dca2-416f-93a2-04359b8cdffb tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:37.331614 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.objects.instance [None req-a79d5784-dca2-416f-93a2-04359b8cdffb tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lazy-loading 'fault' on Instance uuid 62e52230-0b5f-40d0-9464-29013d763e38 {{(pid=119301) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:16:37.372325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-a79d5784-dca2-416f-93a2-04359b8cdffb tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc2adc111449ef94bc8d9c4f55d9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe5d8b30620426aa0f7ee63ee9829da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:37.380475 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a79d5784-dca2-416f-93a2-04359b8cdffb tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 200 len: 1303 microversion: 2.1 time: 0.095881 Oct 14 03:16:37.381039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 539/1063] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:37 2022] GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:37.842594 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-08074a72-49e3-437b-89c2-dbbcc6d55841 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:37.845688 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-08074a72-49e3-437b-89c2-dbbcc6d55841 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:37.850063 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-08074a72-49e3-437b-89c2-dbbcc6d55841 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:37.850560 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-08074a72-49e3-437b-89c2-dbbcc6d55841 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:37.851001 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-08074a72-49e3-437b-89c2-dbbcc6d55841 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:37.851719 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-08074a72-49e3-437b-89c2-dbbcc6d55841 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:37.852170 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-08074a72-49e3-437b-89c2-dbbcc6d55841 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:37.852625 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-08074a72-49e3-437b-89c2-dbbcc6d55841 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:37.988572 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-08074a72-49e3-437b-89c2-dbbcc6d55841 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:37.996381 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-08074a72-49e3-437b-89c2-dbbcc6d55841 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.159327 Oct 14 03:16:37.996957 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 525/1064] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:37 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:38.403414 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9613dd52-c583-4983-a3d0-f98297d19c2b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:38.404029 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-9613dd52-c583-4983-a3d0-f98297d19c2b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] [instance: 62e52230-0b5f-40d0-9464-29013d763e38] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:38.410401 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9613dd52-c583-4983-a3d0-f98297d19c2b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:38.410882 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9613dd52-c583-4983-a3d0-f98297d19c2b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:38.411316 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9613dd52-c583-4983-a3d0-f98297d19c2b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:38.412003 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9613dd52-c583-4983-a3d0-f98297d19c2b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:38.412482 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9613dd52-c583-4983-a3d0-f98297d19c2b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:38.417804 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-9613dd52-c583-4983-a3d0-f98297d19c2b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:38.426702 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-9613dd52-c583-4983-a3d0-f98297d19c2b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] HTTP exception thrown: Instance 62e52230-0b5f-40d0-9464-29013d763e38 could not be found. Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9613dd52-c583-4983-a3d0-f98297d19c2b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Request method failure captured: Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 HTTP/1.1 Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNRz5TnUJ8PnWM4zePYtdqI672SctrFsvFt2Vpl2oKXhtu28X6eOm3AnOHkUrYDpjJ8NGBz-7aNfTbpr_foWM4UPVaPlqfYex3bj4LJF6B0ugkiiyHYaNo7JbY4LMNWtw2lqbEkOOGKyeC9jQ0fsXbYzdLiXWszDnn0698nXo8qt3nE Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: afe5d8b30620426aa0f7ee63ee9829da Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-VolumesActionsTest-1986777034 Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:16:38.428325 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:16:38.430039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afe5d8b30620426aa0f7ee63ee9829da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afe5d8b30620426aa0f7ee63ee9829da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/afe5d8b30620426aa0f7ee63ee9829da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_afe5d8b30620426aa0f7ee63ee9829da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:16:38.430039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-VolumesActionsTest-1986777034 Oct 14 03:16:38.430039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: afe5d8b30620426aa0f7ee63ee9829da Oct 14 03:16:38.430039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-VolumesActionsTest-1986777034 Oct 14 03:16:38.430039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-VolumesActionsTest-1986777034-project Oct 14 03:16:38.430039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:16:38.430039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:16:38.430039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 1fbc2adc111449ef94bc8d9c4f55d9e8 Oct 14 03:16:38.430039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-VolumesActionsTest-1986777034-project Oct 14 03:16:38.430039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:16:38.430039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance 62e52230-0b5f-40d0-9464-29013d763e38 could not be found. Oct 14 03:16:38.430039 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '62e52230-0b5f-40d0-9464-29013d763e38'} Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e52230-0b5f-40d0-9464-29013d763e38 could not be found. Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:16:38.430981 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e52230-0b5f-40d0-9464-29013d763e38 could not be found. Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e52230-0b5f-40d0-9464-29013d763e38 could not be found. Oct 14 03:16:38.432512 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:16:38.433902 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-9613dd52-c583-4983-a3d0-f98297d19c2b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] Returning 404 to user: Instance 62e52230-0b5f-40d0-9464-29013d763e38 could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:16:38.433902 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-9613dd52-c583-4983-a3d0-f98297d19c2b tempest-VolumesActionsTest-1986777034 tempest-VolumesActionsTest-1986777034-project] 10.222.0.13 "GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38" status: 404 len: 111 microversion: 2.1 time: 0.030266 Oct 14 03:16:38.433902 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 540/1065] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:38 2022] GET /compute/v2.1/servers/62e52230-0b5f-40d0-9464-29013d763e38 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:16:39.019188 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-65f7097b-dce5-4028-b5e4-13e01e0abd19 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:39.019903 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-65f7097b-dce5-4028-b5e4-13e01e0abd19 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:39.026458 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-65f7097b-dce5-4028-b5e4-13e01e0abd19 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:39.026950 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-65f7097b-dce5-4028-b5e4-13e01e0abd19 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:39.027398 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-65f7097b-dce5-4028-b5e4-13e01e0abd19 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:39.028101 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-65f7097b-dce5-4028-b5e4-13e01e0abd19 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:39.028599 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-65f7097b-dce5-4028-b5e4-13e01e0abd19 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:39.029531 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-65f7097b-dce5-4028-b5e4-13e01e0abd19 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:39.159392 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-65f7097b-dce5-4028-b5e4-13e01e0abd19 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:39.167379 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-65f7097b-dce5-4028-b5e4-13e01e0abd19 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.152050 Oct 14 03:16:39.168179 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 526/1066] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:39 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:40.191224 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d7ba1640-77c5-4b06-bfe3-05cd53963ece tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:40.191830 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d7ba1640-77c5-4b06-bfe3-05cd53963ece tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:40.194247 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:40.199246 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d7ba1640-77c5-4b06-bfe3-05cd53963ece tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:40.199732 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d7ba1640-77c5-4b06-bfe3-05cd53963ece tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:40.200166 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d7ba1640-77c5-4b06-bfe3-05cd53963ece tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:40.201448 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d7ba1640-77c5-4b06-bfe3-05cd53963ece tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:40.201903 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d7ba1640-77c5-4b06-bfe3-05cd53963ece tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:40.202326 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d7ba1640-77c5-4b06-bfe3-05cd53963ece tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:40.332999 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-d7ba1640-77c5-4b06-bfe3-05cd53963ece tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:40.340845 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d7ba1640-77c5-4b06-bfe3-05cd53963ece tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.153588 Oct 14 03:16:40.341413 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 541/1067] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:40 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:41.363208 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-ea7feb49-a18e-4c2e-ad50-e42eab060c65 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:41.363939 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-ea7feb49-a18e-4c2e-ad50-e42eab060c65 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:41.370788 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 14 03:16:41.371061 dv-cinder-801522-13-smb devstack@n-api.service[119302]: Fri Oct 14 03:16:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 (ip 10.222.0.13) !!! Oct 14 03:16:41.373612 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea7feb49-a18e-4c2e-ad50-e42eab060c65 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:41.374225 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea7feb49-a18e-4c2e-ad50-e42eab060c65 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:41.374739 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea7feb49-a18e-4c2e-ad50-e42eab060c65 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:41.375561 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea7feb49-a18e-4c2e-ad50-e42eab060c65 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:41.376092 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea7feb49-a18e-4c2e-ad50-e42eab060c65 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:41.376626 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-ea7feb49-a18e-4c2e-ad50-e42eab060c65 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:41.523411 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-ea7feb49-a18e-4c2e-ad50-e42eab060c65 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:41.531867 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-ea7feb49-a18e-4c2e-ad50-e42eab060c65 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.172455 Oct 14 03:16:41.532662 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 527/1068] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:41 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:42.555609 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f06cc0fe-5dc3-44e4-9aba-b1d3eddbaac2 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:42.556917 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f06cc0fe-5dc3-44e4-9aba-b1d3eddbaac2 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:42.564200 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f06cc0fe-5dc3-44e4-9aba-b1d3eddbaac2 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:42.564723 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f06cc0fe-5dc3-44e4-9aba-b1d3eddbaac2 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:42.565167 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f06cc0fe-5dc3-44e4-9aba-b1d3eddbaac2 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:42.565872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f06cc0fe-5dc3-44e4-9aba-b1d3eddbaac2 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:42.566333 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f06cc0fe-5dc3-44e4-9aba-b1d3eddbaac2 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:42.566757 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f06cc0fe-5dc3-44e4-9aba-b1d3eddbaac2 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:42.710319 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f06cc0fe-5dc3-44e4-9aba-b1d3eddbaac2 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:42.718811 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f06cc0fe-5dc3-44e4-9aba-b1d3eddbaac2 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.166982 Oct 14 03:16:42.719394 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 542/1069] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:42 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:43.744562 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d1c55e80-572f-45d1-8c41-11c9617365da tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:43.745398 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d1c55e80-572f-45d1-8c41-11c9617365da tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:43.752693 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d1c55e80-572f-45d1-8c41-11c9617365da tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:43.753458 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d1c55e80-572f-45d1-8c41-11c9617365da tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:43.753994 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d1c55e80-572f-45d1-8c41-11c9617365da tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:43.754965 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d1c55e80-572f-45d1-8c41-11c9617365da tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:43.755548 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d1c55e80-572f-45d1-8c41-11c9617365da tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:43.756265 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d1c55e80-572f-45d1-8c41-11c9617365da tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:43.912269 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-d1c55e80-572f-45d1-8c41-11c9617365da tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:43.920065 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d1c55e80-572f-45d1-8c41-11c9617365da tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.181062 Oct 14 03:16:43.920673 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 528/1070] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:43 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:44.943145 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-e3234afd-2098-4814-8e57-b5fffb34055c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:44.943758 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-e3234afd-2098-4814-8e57-b5fffb34055c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:44.950526 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e3234afd-2098-4814-8e57-b5fffb34055c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:44.950996 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e3234afd-2098-4814-8e57-b5fffb34055c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:44.951468 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e3234afd-2098-4814-8e57-b5fffb34055c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:44.952174 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e3234afd-2098-4814-8e57-b5fffb34055c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:44.952654 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e3234afd-2098-4814-8e57-b5fffb34055c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:44.953085 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-e3234afd-2098-4814-8e57-b5fffb34055c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:45.095274 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-e3234afd-2098-4814-8e57-b5fffb34055c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:45.104033 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-e3234afd-2098-4814-8e57-b5fffb34055c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.164748 Oct 14 03:16:45.104963 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 543/1071] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:44 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:46.130142 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-39348453-c9ea-41f3-8697-4b3c713facec tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:46.131320 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-39348453-c9ea-41f3-8697-4b3c713facec tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:46.138422 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-39348453-c9ea-41f3-8697-4b3c713facec tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:46.139524 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-39348453-c9ea-41f3-8697-4b3c713facec tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:46.140028 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-39348453-c9ea-41f3-8697-4b3c713facec tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:46.141037 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-39348453-c9ea-41f3-8697-4b3c713facec tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:46.143095 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-39348453-c9ea-41f3-8697-4b3c713facec tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:46.143538 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-39348453-c9ea-41f3-8697-4b3c713facec tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:46.344982 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-39348453-c9ea-41f3-8697-4b3c713facec tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:46.354032 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-39348453-c9ea-41f3-8697-4b3c713facec tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.228254 Oct 14 03:16:46.356251 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 529/1072] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:46 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:47.397894 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-6f16a972-a0d2-457e-9630-83f3f73f973d tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:47.398649 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-6f16a972-a0d2-457e-9630-83f3f73f973d tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:47.405739 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6f16a972-a0d2-457e-9630-83f3f73f973d tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:47.406231 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6f16a972-a0d2-457e-9630-83f3f73f973d tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:47.406941 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6f16a972-a0d2-457e-9630-83f3f73f973d tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:47.407881 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6f16a972-a0d2-457e-9630-83f3f73f973d tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:47.408336 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6f16a972-a0d2-457e-9630-83f3f73f973d tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:47.409034 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6f16a972-a0d2-457e-9630-83f3f73f973d tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:47.557522 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-6f16a972-a0d2-457e-9630-83f3f73f973d tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:47.570168 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-6f16a972-a0d2-457e-9630-83f3f73f973d tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.176038 Oct 14 03:16:47.571537 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 544/1073] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:47 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:48.594568 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-f5a162e4-724e-4dca-ac60-fea0968bddd6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:48.595186 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-f5a162e4-724e-4dca-ac60-fea0968bddd6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:48.604185 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f5a162e4-724e-4dca-ac60-fea0968bddd6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:48.605161 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f5a162e4-724e-4dca-ac60-fea0968bddd6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:48.606102 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f5a162e4-724e-4dca-ac60-fea0968bddd6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:48.606891 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f5a162e4-724e-4dca-ac60-fea0968bddd6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:48.607530 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f5a162e4-724e-4dca-ac60-fea0968bddd6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:48.608127 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-f5a162e4-724e-4dca-ac60-fea0968bddd6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:48.761795 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-f5a162e4-724e-4dca-ac60-fea0968bddd6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:48.770821 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-f5a162e4-724e-4dca-ac60-fea0968bddd6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1511 microversion: 2.1 time: 0.180109 Oct 14 03:16:48.771516 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 530/1074] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:48 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:48.793923 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-a791cb54-3964-4962-b3e1-5c8ef5eb96ac tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:48.794535 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a791cb54-3964-4962-b3e1-5c8ef5eb96ac tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:48.801599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a791cb54-3964-4962-b3e1-5c8ef5eb96ac tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:48.802094 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a791cb54-3964-4962-b3e1-5c8ef5eb96ac tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:48.802539 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a791cb54-3964-4962-b3e1-5c8ef5eb96ac tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:48.803393 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a791cb54-3964-4962-b3e1-5c8ef5eb96ac tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:48.804029 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a791cb54-3964-4962-b3e1-5c8ef5eb96ac tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:48.804652 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-a791cb54-3964-4962-b3e1-5c8ef5eb96ac tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:48.836202 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-a791cb54-3964-4962-b3e1-5c8ef5eb96ac tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119301) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 14 03:16:49.185188 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-a791cb54-3964-4962-b3e1-5c8ef5eb96ac tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "POST /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7/action" status: 202 len: 0 microversion: 2.1 time: 0.395151 Oct 14 03:16:49.189494 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 545/1075] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Oct 14 03:16:48 2022] POST /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:16:49.195331 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-55ba2f90-2739-421e-84ce-090ea2557e85 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:49.195331 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-55ba2f90-2739-421e-84ce-090ea2557e85 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:49.209472 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-55ba2f90-2739-421e-84ce-090ea2557e85 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:49.209983 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-55ba2f90-2739-421e-84ce-090ea2557e85 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:49.210439 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-55ba2f90-2739-421e-84ce-090ea2557e85 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:49.211167 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-55ba2f90-2739-421e-84ce-090ea2557e85 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:49.211636 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-55ba2f90-2739-421e-84ce-090ea2557e85 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:49.212076 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-55ba2f90-2739-421e-84ce-090ea2557e85 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:49.364440 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-55ba2f90-2739-421e-84ce-090ea2557e85 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:49.372643 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-55ba2f90-2739-421e-84ce-090ea2557e85 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1519 microversion: 2.1 time: 0.182039 Oct 14 03:16:49.374902 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 531/1076] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:49 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:49.676373 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-38ed3a57-db0e-4f75-b7fa-e744a791eb1e req-801a3693-1e53-49f3-9cad-e3e907f414fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2c238c-787c-4bb0-b123-61e7d380c8b7", "name": "network-vif-unplugged", "status": "completed", "tag": "49070fc8-b204-45c9-b9e0-f8e67c3fa614"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:49.698873 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-38ed3a57-db0e-4f75-b7fa-e744a791eb1e req-801a3693-1e53-49f3-9cad-e3e907f414fc service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:49.699359 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-38ed3a57-db0e-4f75-b7fa-e744a791eb1e req-801a3693-1e53-49f3-9cad-e3e907f414fc service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:49.699801 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-38ed3a57-db0e-4f75-b7fa-e744a791eb1e req-801a3693-1e53-49f3-9cad-e3e907f414fc service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:49.715481 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.compute.server_external_events [req-38ed3a57-db0e-4f75-b7fa-e744a791eb1e req-801a3693-1e53-49f3-9cad-e3e907f414fc service nova] Unable to find a host for instance 9c2c238c-787c-4bb0-b123-61e7d380c8b7. Dropping event network-vif-unplugged {{(pid=119301) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 14 03:16:49.716681 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-38ed3a57-db0e-4f75-b7fa-e744a791eb1e req-801a3693-1e53-49f3-9cad-e3e907f414fc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044346 Oct 14 03:16:49.717721 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 546/1077] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 14 03:16:50.396227 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-d60e8d36-dd53-40e5-8e2e-fd9950b4e25b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:50.396885 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-d60e8d36-dd53-40e5-8e2e-fd9950b4e25b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:50.403268 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d60e8d36-dd53-40e5-8e2e-fd9950b4e25b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:50.403755 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d60e8d36-dd53-40e5-8e2e-fd9950b4e25b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:50.404195 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d60e8d36-dd53-40e5-8e2e-fd9950b4e25b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:50.405438 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d60e8d36-dd53-40e5-8e2e-fd9950b4e25b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:50.405905 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d60e8d36-dd53-40e5-8e2e-fd9950b4e25b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:50.406335 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-d60e8d36-dd53-40e5-8e2e-fd9950b4e25b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:50.548854 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-d60e8d36-dd53-40e5-8e2e-fd9950b4e25b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:50.560534 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-d60e8d36-dd53-40e5-8e2e-fd9950b4e25b tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1519 microversion: 2.1 time: 0.167966 Oct 14 03:16:50.561577 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 532/1078] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:50 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:51.589927 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-f3186b0f-a727-4078-8f42-c55322b26fc8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:51.590695 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-f3186b0f-a727-4078-8f42-c55322b26fc8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:51.597836 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f3186b0f-a727-4078-8f42-c55322b26fc8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:51.598426 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f3186b0f-a727-4078-8f42-c55322b26fc8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:51.599292 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f3186b0f-a727-4078-8f42-c55322b26fc8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:51.600526 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f3186b0f-a727-4078-8f42-c55322b26fc8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:51.601363 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f3186b0f-a727-4078-8f42-c55322b26fc8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:51.602173 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-f3186b0f-a727-4078-8f42-c55322b26fc8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:51.785340 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-f3186b0f-a727-4078-8f42-c55322b26fc8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:51.794687 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-f3186b0f-a727-4078-8f42-c55322b26fc8 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1521 microversion: 2.1 time: 0.210103 Oct 14 03:16:51.797361 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 547/1079] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:51 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:52.821084 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-9b9eef93-f194-408c-a441-8173f64d95fd tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:52.822516 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-9b9eef93-f194-408c-a441-8173f64d95fd tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:52.830106 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b9eef93-f194-408c-a441-8173f64d95fd tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:52.830895 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b9eef93-f194-408c-a441-8173f64d95fd tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:52.831539 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b9eef93-f194-408c-a441-8173f64d95fd tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:52.833435 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b9eef93-f194-408c-a441-8173f64d95fd tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:52.834284 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b9eef93-f194-408c-a441-8173f64d95fd tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:52.834965 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-9b9eef93-f194-408c-a441-8173f64d95fd tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:52.996801 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-9b9eef93-f194-408c-a441-8173f64d95fd tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:53.006735 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-9b9eef93-f194-408c-a441-8173f64d95fd tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1577 microversion: 2.1 time: 0.189840 Oct 14 03:16:53.007345 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 533/1080] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:52 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:54.032346 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-6645d2da-c13e-479b-8f93-54cf0c52835c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:54.032944 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-6645d2da-c13e-479b-8f93-54cf0c52835c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:54.039932 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6645d2da-c13e-479b-8f93-54cf0c52835c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:54.040456 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6645d2da-c13e-479b-8f93-54cf0c52835c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:54.040918 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6645d2da-c13e-479b-8f93-54cf0c52835c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:54.041637 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6645d2da-c13e-479b-8f93-54cf0c52835c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:54.042128 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6645d2da-c13e-479b-8f93-54cf0c52835c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:54.042558 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-6645d2da-c13e-479b-8f93-54cf0c52835c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:54.196667 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-6645d2da-c13e-479b-8f93-54cf0c52835c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:54.205158 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-6645d2da-c13e-479b-8f93-54cf0c52835c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1577 microversion: 2.1 time: 0.177831 Oct 14 03:16:54.206320 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 548/1081] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:54 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:55.233580 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-1de1624c-822f-4e09-99fd-ea689739349f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:55.234258 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-1de1624c-822f-4e09-99fd-ea689739349f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:55.241073 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1de1624c-822f-4e09-99fd-ea689739349f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:55.241565 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1de1624c-822f-4e09-99fd-ea689739349f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:55.242007 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1de1624c-822f-4e09-99fd-ea689739349f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:55.242713 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1de1624c-822f-4e09-99fd-ea689739349f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:55.243173 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1de1624c-822f-4e09-99fd-ea689739349f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:55.243604 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-1de1624c-822f-4e09-99fd-ea689739349f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:55.389116 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-1de1624c-822f-4e09-99fd-ea689739349f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:55.398507 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-1de1624c-822f-4e09-99fd-ea689739349f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1577 microversion: 2.1 time: 0.168691 Oct 14 03:16:55.399092 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 534/1082] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:55 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:56.422946 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-039b0dc7-60e0-47db-90bb-7ebdf5eb03e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:56.423760 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-039b0dc7-60e0-47db-90bb-7ebdf5eb03e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:56.430810 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-039b0dc7-60e0-47db-90bb-7ebdf5eb03e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:56.431305 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-039b0dc7-60e0-47db-90bb-7ebdf5eb03e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:56.431748 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-039b0dc7-60e0-47db-90bb-7ebdf5eb03e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:56.432487 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-039b0dc7-60e0-47db-90bb-7ebdf5eb03e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:56.432956 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-039b0dc7-60e0-47db-90bb-7ebdf5eb03e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:56.433393 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-039b0dc7-60e0-47db-90bb-7ebdf5eb03e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:56.439014 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:56.591711 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-039b0dc7-60e0-47db-90bb-7ebdf5eb03e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:56.601996 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-039b0dc7-60e0-47db-90bb-7ebdf5eb03e6 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1577 microversion: 2.1 time: 0.183500 Oct 14 03:16:56.608021 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 549/1083] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:56 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:57.626374 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-e9f74e98-2b6d-4d1d-9519-627a8fe14a4f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:57.627024 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-e9f74e98-2b6d-4d1d-9519-627a8fe14a4f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:57.633294 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e9f74e98-2b6d-4d1d-9519-627a8fe14a4f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:57.633897 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e9f74e98-2b6d-4d1d-9519-627a8fe14a4f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:57.634316 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e9f74e98-2b6d-4d1d-9519-627a8fe14a4f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:57.635081 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e9f74e98-2b6d-4d1d-9519-627a8fe14a4f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:57.635543 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e9f74e98-2b6d-4d1d-9519-627a8fe14a4f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:57.635973 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-e9f74e98-2b6d-4d1d-9519-627a8fe14a4f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:57.754072 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-55e6c797-8c44-41ee-adb4-1f4d02b0bfe1 req-4e1552ac-bdbb-4bf8-b834-ea544339bc96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2c238c-787c-4bb0-b123-61e7d380c8b7", "name": "network-vif-plugged", "status": "completed", "tag": "49070fc8-b204-45c9-b9e0-f8e67c3fa614"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:57.764505 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-55e6c797-8c44-41ee-adb4-1f4d02b0bfe1 req-4e1552ac-bdbb-4bf8-b834-ea544339bc96 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:57.765010 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-55e6c797-8c44-41ee-adb4-1f4d02b0bfe1 req-4e1552ac-bdbb-4bf8-b834-ea544339bc96 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:57.765599 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-55e6c797-8c44-41ee-adb4-1f4d02b0bfe1 req-4e1552ac-bdbb-4bf8-b834-ea544339bc96 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:57.768785 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-e9f74e98-2b6d-4d1d-9519-627a8fe14a4f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:57.776656 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-e9f74e98-2b6d-4d1d-9519-627a8fe14a4f tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1577 microversion: 2.1 time: 0.154413 Oct 14 03:16:57.776833 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-55e6c797-8c44-41ee-adb4-1f4d02b0bfe1 req-4e1552ac-bdbb-4bf8-b834-ea544339bc96 service nova] Creating event network-vif-plugged:49070fc8-b204-45c9-b9e0-f8e67c3fa614 for instance 9c2c238c-787c-4bb0-b123-61e7d380c8b7 on hv-cinder-80152 Oct 14 03:16:57.777558 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 535/1084] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:57 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:57.782305 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-55e6c797-8c44-41ee-adb4-1f4d02b0bfe1 req-4e1552ac-bdbb-4bf8-b834-ea544339bc96 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032003 Oct 14 03:16:57.782933 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 550/1085] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:16:58.801708 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-76158693-0b99-4a04-a410-0574a62fc155 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:58.802327 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-76158693-0b99-4a04-a410-0574a62fc155 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:58.808813 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-76158693-0b99-4a04-a410-0574a62fc155 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:58.811238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-76158693-0b99-4a04-a410-0574a62fc155 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:58.811238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-76158693-0b99-4a04-a410-0574a62fc155 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:58.811238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-76158693-0b99-4a04-a410-0574a62fc155 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:58.811238 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-76158693-0b99-4a04-a410-0574a62fc155 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:58.811622 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-76158693-0b99-4a04-a410-0574a62fc155 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:58.941128 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-76158693-0b99-4a04-a410-0574a62fc155 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:58.948953 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-76158693-0b99-4a04-a410-0574a62fc155 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1577 microversion: 2.1 time: 0.151381 Oct 14 03:16:58.949522 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 536/1086] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:58 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:59.972232 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-06174224-2eaa-41b7-8b56-533d4d459c36 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:59.972892 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-06174224-2eaa-41b7-8b56-533d4d459c36 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:59.979447 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-06174224-2eaa-41b7-8b56-533d4d459c36 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:59.979924 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-06174224-2eaa-41b7-8b56-533d4d459c36 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:59.980356 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-06174224-2eaa-41b7-8b56-533d4d459c36 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:59.981067 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-06174224-2eaa-41b7-8b56-533d4d459c36 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:59.981516 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-06174224-2eaa-41b7-8b56-533d4d459c36 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:59.981937 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-06174224-2eaa-41b7-8b56-533d4d459c36 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:00.119642 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-06174224-2eaa-41b7-8b56-533d4d459c36 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:00.131275 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-06174224-2eaa-41b7-8b56-533d4d459c36 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1564 microversion: 2.1 time: 0.163887 Oct 14 03:17:00.131849 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 551/1087] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:59 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:14.416876 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:14.417614 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG dbcounter [-] [119301] Writing DB stats nova_cell1:SELECT=12 {{(pid=119301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:14.418488 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 14 03:18:14.418636 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Fri Oct 14 03:18:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Oct 14 03:18:14.419142 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_api:SELECT=27 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:14.420023 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG dbcounter [-] [119302] Writing DB stats nova_cell1:SELECT=79 {{(pid=119302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:14.421710 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 14 03:18:14.427348 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-a1ce2f0a-bf10-4154-9de4-8fe015d0c6c3 req-a0e6c908-92b6-4718-85be-74ed50fdfcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c2c238c-787c-4bb0-b123-61e7d380c8b7", "tag": "49070fc8-b204-45c9-b9e0-f8e67c3fa614"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:18:14.439594 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-a1ce2f0a-bf10-4154-9de4-8fe015d0c6c3 req-a0e6c908-92b6-4718-85be-74ed50fdfcd5 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:14.446140 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-a1ce2f0a-bf10-4154-9de4-8fe015d0c6c3 req-a0e6c908-92b6-4718-85be-74ed50fdfcd5 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:14.446302 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-bdde3c86-deb9-41a3-9452-af6d579d6703 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:14.446411 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-a1ce2f0a-bf10-4154-9de4-8fe015d0c6c3 req-a0e6c908-92b6-4718-85be-74ed50fdfcd5 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:14.446507 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-bdde3c86-deb9-41a3-9452-af6d579d6703 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:14.447024 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bdde3c86-deb9-41a3-9452-af6d579d6703 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:14.447513 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bdde3c86-deb9-41a3-9452-af6d579d6703 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:14.447947 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bdde3c86-deb9-41a3-9452-af6d579d6703 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:14.449872 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bdde3c86-deb9-41a3-9452-af6d579d6703 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:14.449872 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bdde3c86-deb9-41a3-9452-af6d579d6703 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:14.449872 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-bdde3c86-deb9-41a3-9452-af6d579d6703 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:14.452578 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-a1ce2f0a-bf10-4154-9de4-8fe015d0c6c3 req-a0e6c908-92b6-4718-85be-74ed50fdfcd5 service nova] Creating event network-changed:49070fc8-b204-45c9-b9e0-f8e67c3fa614 for instance 9c2c238c-787c-4bb0-b123-61e7d380c8b7 on hv-cinder-80152 Oct 14 03:18:14.457781 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-a1ce2f0a-bf10-4154-9de4-8fe015d0c6c3 req-a0e6c908-92b6-4718-85be-74ed50fdfcd5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042506 Oct 14 03:18:14.458633 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 552/1088] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:18:14.474575 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-bdde3c86-deb9-41a3-9452-af6d579d6703 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Going to try to terminate instance {{(pid=119302) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:18:14.757433 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-bdde3c86-deb9-41a3-9452-af6d579d6703 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 204 len: 0 microversion: 2.1 time: 0.344716 Oct 14 03:18:14.758199 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 537/1089] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Oct 14 03:18:14 2022] DELETE /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:18:14.768226 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-3a706c6f-091f-4853-8468-7fd507321fcc tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:14.769364 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-3a706c6f-091f-4853-8468-7fd507321fcc tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:14.776916 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a706c6f-091f-4853-8468-7fd507321fcc tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:14.777597 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a706c6f-091f-4853-8468-7fd507321fcc tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:14.778271 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a706c6f-091f-4853-8468-7fd507321fcc tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:14.779051 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a706c6f-091f-4853-8468-7fd507321fcc tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:14.779718 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a706c6f-091f-4853-8468-7fd507321fcc tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:14.780239 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-3a706c6f-091f-4853-8468-7fd507321fcc tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:15.025177 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.policy [None req-3a706c6f-091f-4853-8468-7fd507321fcc tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119301) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:15.033872 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-3a706c6f-091f-4853-8468-7fd507321fcc tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.271114 Oct 14 03:18:15.034439 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 553/1090] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:14 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:16.057095 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-63c66edb-255d-406a-80b8-98d2d5bd7aeb tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:16.058058 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-63c66edb-255d-406a-80b8-98d2d5bd7aeb tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:16.064717 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-63c66edb-255d-406a-80b8-98d2d5bd7aeb tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:16.065204 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-63c66edb-255d-406a-80b8-98d2d5bd7aeb tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:16.065640 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-63c66edb-255d-406a-80b8-98d2d5bd7aeb tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:16.066331 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-63c66edb-255d-406a-80b8-98d2d5bd7aeb tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:16.066802 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-63c66edb-255d-406a-80b8-98d2d5bd7aeb tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:16.067227 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-63c66edb-255d-406a-80b8-98d2d5bd7aeb tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:16.247486 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-63c66edb-255d-406a-80b8-98d2d5bd7aeb tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:16.255729 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-63c66edb-255d-406a-80b8-98d2d5bd7aeb tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1570 microversion: 2.1 time: 0.203018 Oct 14 03:18:16.256303 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 538/1091] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:16 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1570 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:16.944171 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [req-a7e36d89-dd5f-4160-9289-70258aad106c req-42856107-7ea9-434e-98da-856cbd71f687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2c238c-787c-4bb0-b123-61e7d380c8b7", "name": "network-vif-deleted", "tag": "49070fc8-b204-45c9-b9e0-f8e67c3fa614"}]} {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:18:16.953507 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-a7e36d89-dd5f-4160-9289-70258aad106c req-42856107-7ea9-434e-98da-856cbd71f687 service nova] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:16.954017 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-a7e36d89-dd5f-4160-9289-70258aad106c req-42856107-7ea9-434e-98da-856cbd71f687 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:16.954449 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [req-a7e36d89-dd5f-4160-9289-70258aad106c req-42856107-7ea9-434e-98da-856cbd71f687 service nova] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:16.965034 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.compute.server_external_events [req-a7e36d89-dd5f-4160-9289-70258aad106c req-42856107-7ea9-434e-98da-856cbd71f687 service nova] Creating event network-vif-deleted:49070fc8-b204-45c9-b9e0-f8e67c3fa614 for instance 9c2c238c-787c-4bb0-b123-61e7d380c8b7 on hv-cinder-80152 Oct 14 03:18:16.970703 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [req-a7e36d89-dd5f-4160-9289-70258aad106c req-42856107-7ea9-434e-98da-856cbd71f687 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087065 Oct 14 03:18:16.971316 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 554/1092] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Oct 14 03:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:18:17.279210 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-7e6252b1-f75d-41aa-a17d-6c4874ce1b5c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:17.279834 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.compute.api [None req-7e6252b1-f75d-41aa-a17d-6c4874ce1b5c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119302) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:17.296933 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e6252b1-f75d-41aa-a17d-6c4874ce1b5c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:17.297733 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e6252b1-f75d-41aa-a17d-6c4874ce1b5c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:17.298182 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e6252b1-f75d-41aa-a17d-6c4874ce1b5c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:17.298889 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e6252b1-f75d-41aa-a17d-6c4874ce1b5c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:17.299453 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e6252b1-f75d-41aa-a17d-6c4874ce1b5c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:17.299848 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG oslo_concurrency.lockutils [None req-7e6252b1-f75d-41aa-a17d-6c4874ce1b5c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:17.361015 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.policy [None req-7e6252b1-f75d-41aa-a17d-6c4874ce1b5c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0f893d26f44c9d99a8c855de0fa16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459af465b6664bf2b571e931c87c52d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119302) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:17.368683 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-7e6252b1-f75d-41aa-a17d-6c4874ce1b5c tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 200 len: 1220 microversion: 2.1 time: 0.093512 Oct 14 03:18:17.373683 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 539/1093] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:17 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:18.393269 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d5e84efd-e40b-4d3e-bdc8-9283365e4601 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '>' {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:18.394078 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.compute.api [None req-d5e84efd-e40b-4d3e-bdc8-9283365e4601 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] [instance: 9c2c238c-787c-4bb0-b123-61e7d380c8b7] Fetching instance by UUID {{(pid=119301) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:18.400193 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d5e84efd-e40b-4d3e-bdc8-9283365e4601 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:18.400714 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d5e84efd-e40b-4d3e-bdc8-9283365e4601 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:18.401154 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d5e84efd-e40b-4d3e-bdc8-9283365e4601 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:18.401842 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d5e84efd-e40b-4d3e-bdc8-9283365e4601 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Acquiring lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:18.402294 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d5e84efd-e40b-4d3e-bdc8-9283365e4601 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:18.402716 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG oslo_concurrency.lockutils [None req-d5e84efd-e40b-4d3e-bdc8-9283365e4601 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Lock "e228678d-bf1f-4de4-9ba4-dd43fa30f246" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:18.415513 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.wsgi [None req-d5e84efd-e40b-4d3e-bdc8-9283365e4601 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] HTTP exception thrown: Instance 9c2c238c-787c-4bb0-b123-61e7d380c8b7 could not be found. Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d5e84efd-e40b-4d3e-bdc8-9283365e4601 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Request method failure captured: Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: request: GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 HTTP/1.1 Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept: application/json Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Accept-Encoding: identity Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Connection: close Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Length: 0 Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Content-Type: application/json Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Host: 10.222.0.13 Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: Openstack-System-Scope: None Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: User-Agent: python-urllib3/1.26.12 Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Auth-Token: gAAAAABjSNPq9caQRDwIw8gMB7bVbK3kKcRfhHm1-z599BtSeyoZqQL_D0KDsx2r65GiZ8DpRTrez6ZdQbioMAomBHwDI4OxPycT8_2Ttc0P8a3YXYybIrEKqTO84vocC_hdMlgeznpT_mGwBD8t8OBzTtrT8dsTC61vOzWvxqIhm3zoTgC9Ifs Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Id: None Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Domain-Name: None Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Identity-Status: Confirmed Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Is-Admin-Project: True Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Id: default Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Domain-Name: Default Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Id: 459af465b6664bf2b571e931c87c52d6 Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Project-Name: tempest-TestShelveInstance-1645904072 Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Role: member,reader Oct 14 03:18:18.417149 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Roles: member,reader Oct 14 03:18:18.418938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/459af465b6664bf2b571e931c87c52d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/459af465b6664bf2b571e931c87c52d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/459af465b6664bf2b571e931c87c52d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_459af465b6664bf2b571e931c87c52d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}] Oct 14 03:18:18.418938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant: tempest-TestShelveInstance-1645904072 Oct 14 03:18:18.418938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Id: 459af465b6664bf2b571e931c87c52d6 Oct 14 03:18:18.418938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-Tenant-Name: tempest-TestShelveInstance-1645904072 Oct 14 03:18:18.418938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User: tempest-TestShelveInstance-1645904072-project Oct 14 03:18:18.418938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Id: default Oct 14 03:18:18.418938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Domain-Name: Default Oct 14 03:18:18.418938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Id: 9b0f893d26f44c9d99a8c855de0fa16f Oct 14 03:18:18.418938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: X-User-Name: tempest-TestShelveInstance-1645904072-project Oct 14 03:18:18.418938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: method: > Oct 14 03:18:18.418938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: exception: Instance 9c2c238c-787c-4bb0-b123-61e7d380c8b7 could not be found. Oct 14 03:18:18.418938 dv-cinder-801522-13-smb devstack@n-api.service[119301]: action_args: {'id': '9c2c238c-787c-4bb0-b123-61e7d380c8b7'} Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: {{(pid=119301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c2c238c-787c-4bb0-b123-61e7d380c8b7 could not be found. Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:18:18.420013 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c2c238c-787c-4bb0-b123-61e7d380c8b7 could not be found. Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c2c238c-787c-4bb0-b123-61e7d380c8b7 could not be found. Oct 14 03:18:18.421673 dv-cinder-801522-13-smb devstack@n-api.service[119301]: ERROR nova.api.openstack.wsgi Oct 14 03:18:18.423143 dv-cinder-801522-13-smb devstack@n-api.service[119301]: DEBUG nova.api.openstack.wsgi [None req-d5e84efd-e40b-4d3e-bdc8-9283365e4601 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Returning 404 to user: Instance 9c2c238c-787c-4bb0-b123-61e7d380c8b7 could not be found. {{(pid=119301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:18:18.423143 dv-cinder-801522-13-smb devstack@n-api.service[119301]: INFO nova.api.openstack.requestlog [None req-d5e84efd-e40b-4d3e-bdc8-9283365e4601 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7" status: 404 len: 111 microversion: 2.1 time: 0.030791 Oct 14 03:18:18.423143 dv-cinder-801522-13-smb devstack@n-api.service[119301]: [pid: 119301|app: 0|req: 555/1094] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:18 2022] GET /compute/v2.1/servers/9c2c238c-787c-4bb0-b123-61e7d380c8b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:18:18.648375 dv-cinder-801522-13-smb devstack@n-api.service[119302]: DEBUG nova.api.openstack.wsgi [None req-02b3b70a-315b-40db-aed8-484c29559982 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] Calling method '.version_select at 0x7fdcc7575160>' {{(pid=119302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:18.753098 dv-cinder-801522-13-smb devstack@n-api.service[119302]: INFO nova.api.openstack.requestlog [None req-02b3b70a-315b-40db-aed8-484c29559982 tempest-TestShelveInstance-1645904072 tempest-TestShelveInstance-1645904072-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1589125991" status: 202 len: 0 microversion: 2.1 time: 0.109010 Oct 14 03:18:18.753689 dv-cinder-801522-13-smb devstack@n-api.service[119302]: [pid: 119302|app: 0|req: 540/1095] 10.222.0.13 () {58 vars in 1254 bytes} [Fri Oct 14 03:18:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1589125991 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)